2023-11-30 20:53:14,064 INFO [main] hbase.HBaseClassTestRule(94): Test class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor timeout: 13 mins 2023-11-30 20:53:14,310 DEBUG [main] hbase.HBaseTestingUtility(342): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a 2023-11-30 20:53:14,327 INFO [Time-limited test] hbase.HBaseTestingUtility(1068): Starting up minicluster with option: StartMiniClusterOption{numMasters=1, masterClass=null, numRegionServers=1, rsPorts=, rsClass=null, numDataNodes=1, dataNodeHosts=null, numZkServers=1, createRootDir=false, createWALDir=false} 2023-11-30 20:53:14,328 INFO [Time-limited test] hbase.HBaseZKTestingUtility(82): Created new mini-cluster data directory: /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/cluster_1a0b3a74-9b82-6bde-be73-7dfdec67973f, deleteOnExit=true 2023-11-30 20:53:14,328 INFO [Time-limited test] hbase.HBaseTestingUtility(1082): STARTING DFS 2023-11-30 20:53:14,329 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting test.cache.data to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/test.cache.data in system properties and HBase conf 2023-11-30 20:53:14,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.tmp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/hadoop.tmp.dir in system properties and HBase conf 2023-11-30 20:53:14,330 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting hadoop.log.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/hadoop.log.dir in system properties and HBase conf 2023-11-30 20:53:14,331 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.local.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/mapreduce.cluster.local.dir in system properties and HBase conf 2023-11-30 20:53:14,331 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting mapreduce.cluster.temp.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/mapreduce.cluster.temp.dir in system properties and HBase conf 2023-11-30 20:53:14,332 INFO [Time-limited test] hbase.HBaseTestingUtility(759): read short circuit is OFF 2023-11-30 20:53:14,460 WARN [Time-limited test] util.NativeCodeLoader(62): Unable to load native-hadoop library for your platform... using builtin-java classes where applicable 2023-11-30 20:53:14,987 DEBUG [Time-limited test] fs.HFileSystem(308): The file system is not a DistributedFileSystem. Skipping on block location reordering 2023-11-30 20:53:14,992 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-labels.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/yarn.node-labels.fs-store.root-dir in system properties and HBase conf 2023-11-30 20:53:14,993 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.node-attribute.fs-store.root-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/yarn.node-attribute.fs-store.root-dir in system properties and HBase conf 2023-11-30 20:53:15,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.log-dirs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/yarn.nodemanager.log-dirs in system properties and HBase conf 2023-11-30 20:53:15,003 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-30 20:53:15,004 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.active-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/yarn.timeline-service.entity-group-fs-store.active-dir in system properties and HBase conf 2023-11-30 20:53:15,018 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.timeline-service.entity-group-fs-store.done-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/yarn.timeline-service.entity-group-fs-store.done-dir in system properties and HBase conf 2023-11-30 20:53:15,019 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting yarn.nodemanager.remote-app-log-dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/yarn.nodemanager.remote-app-log-dir in system properties and HBase conf 2023-11-30 20:53:15,019 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-30 20:53:15,020 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.datanode.shared.file.descriptor.paths to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/dfs.datanode.shared.file.descriptor.paths in system properties and HBase conf 2023-11-30 20:53:15,020 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting nfs.dump.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/nfs.dump.dir in system properties and HBase conf 2023-11-30 20:53:15,021 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting java.io.tmpdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/java.io.tmpdir in system properties and HBase conf 2023-11-30 20:53:15,021 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.journalnode.edits.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/dfs.journalnode.edits.dir in system properties and HBase conf 2023-11-30 20:53:15,021 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting dfs.provided.aliasmap.inmemory.leveldb.dir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/dfs.provided.aliasmap.inmemory.leveldb.dir in system properties and HBase conf 2023-11-30 20:53:15,022 INFO [Time-limited test] hbase.HBaseTestingUtility(772): Setting fs.s3a.committer.staging.tmp.path to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/fs.s3a.committer.staging.tmp.path in system properties and HBase conf Formatting using clusterid: testClusterID 2023-11-30 20:53:15,807 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-30 20:53:15,813 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-30 20:53:16,173 WARN [Time-limited test] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-namenode.properties,hadoop-metrics2.properties 2023-11-30 20:53:16,360 INFO [Time-limited test] log.Slf4jLog(67): Logging to org.slf4j.impl.Reload4jLoggerAdapter(org.mortbay.log) via org.mortbay.log.Slf4jLog 2023-11-30 20:53:16,377 WARN [Time-limited test] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-30 20:53:16,426 INFO [Time-limited test] log.Slf4jLog(67): jetty-6.1.26 2023-11-30 20:53:16,476 INFO [Time-limited test] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/hdfs to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/java.io.tmpdir/Jetty_localhost_44683_hdfs____.rsrup1/webapp 2023-11-30 20:53:16,656 INFO [Time-limited test] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:44683 2023-11-30 20:53:16,669 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.heartbeat.interval(3) assuming SECONDS 2023-11-30 20:53:16,669 WARN [Time-limited test] conf.Configuration(1701): No unit for dfs.namenode.safemode.extension(0) assuming MILLISECONDS 2023-11-30 20:53:17,250 WARN [Listener at localhost/33413] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-30 20:53:17,323 WARN [Listener at localhost/33413] conf.Configuration(1701): No unit for dfs.datanode.outliers.report.interval(1800000) assuming MILLISECONDS 2023-11-30 20:53:17,342 WARN [Listener at localhost/33413] http.HttpRequestLog(97): Jetty request log can only be enabled using Log4j 2023-11-30 20:53:17,350 INFO [Listener at localhost/33413] log.Slf4jLog(67): jetty-6.1.26 2023-11-30 20:53:17,354 INFO [Listener at localhost/33413] log.Slf4jLog(67): Extract jar:file:/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/local-repository/org/apache/hadoop/hadoop-hdfs/2.10.0/hadoop-hdfs-2.10.0-tests.jar!/webapps/datanode to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/java.io.tmpdir/Jetty_localhost_38461_datanode____.w2syb3/webapp 2023-11-30 20:53:17,464 INFO [Listener at localhost/33413] log.Slf4jLog(67): Started HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:38461 2023-11-30 20:53:17,807 WARN [Listener at localhost/34291] common.MetricsLoggerTask(153): Metrics logging will not be async since the logger is not log4j 2023-11-30 20:53:18,362 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f89b1a12c4887ff: Processing first storage report for DS-772da0b1-c481-4133-b182-857409ed6522 from datanode 1cd6f58d-a09b-45ae-95f6-a9f17ea7456d 2023-11-30 20:53:18,363 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f89b1a12c4887ff: from storage DS-772da0b1-c481-4133-b182-857409ed6522 node DatanodeRegistration(127.0.0.1:38669, datanodeUuid=1cd6f58d-a09b-45ae-95f6-a9f17ea7456d, infoPort=44965, infoSecurePort=0, ipcPort=34291, storageInfo=lv=-57;cid=testClusterID;nsid=1372049162;c=1701377595920), blocks: 0, hasStaleStorage: true, processing time: 2 msecs, invalidatedBlocks: 0 2023-11-30 20:53:18,364 INFO [Block report processor] blockmanagement.BlockManager(2202): BLOCK* processReport 0x4f89b1a12c4887ff: Processing first storage report for DS-affa09ae-e407-4324-a5c6-50c7dd95df6a from datanode 1cd6f58d-a09b-45ae-95f6-a9f17ea7456d 2023-11-30 20:53:18,364 INFO [Block report processor] blockmanagement.BlockManager(2228): BLOCK* processReport 0x4f89b1a12c4887ff: from storage DS-affa09ae-e407-4324-a5c6-50c7dd95df6a node DatanodeRegistration(127.0.0.1:38669, datanodeUuid=1cd6f58d-a09b-45ae-95f6-a9f17ea7456d, infoPort=44965, infoSecurePort=0, ipcPort=34291, storageInfo=lv=-57;cid=testClusterID;nsid=1372049162;c=1701377595920), blocks: 0, hasStaleStorage: false, processing time: 0 msecs, invalidatedBlocks: 0 2023-11-30 20:53:18,441 DEBUG [Listener at localhost/34291] hbase.HBaseTestingUtility(649): Setting hbase.rootdir to /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a 2023-11-30 20:53:18,553 INFO [Listener at localhost/34291] zookeeper.MiniZooKeeperCluster(258): Started connectionTimeout=30000, dir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/cluster_1a0b3a74-9b82-6bde-be73-7dfdec67973f/zookeeper_0, clientPort=58095, secureClientPort=-1, dataDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/cluster_1a0b3a74-9b82-6bde-be73-7dfdec67973f/zookeeper_0/version-2, dataDirSize=457 dataLogDir=/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/cluster_1a0b3a74-9b82-6bde-be73-7dfdec67973f/zookeeper_0/version-2, dataLogSize=457 tickTime=2000, maxClientCnxns=300, minSessionTimeout=4000, maxSessionTimeout=40000, clientPortListenBacklog=-1, serverId=0 2023-11-30 20:53:18,569 INFO [Listener at localhost/34291] zookeeper.MiniZooKeeperCluster(283): Started MiniZooKeeperCluster and ran 'stat' on client port=58095 2023-11-30 20:53:18,579 INFO [Listener at localhost/34291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-30 20:53:18,581 INFO [Listener at localhost/34291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-30 20:53:19,251 INFO [Listener at localhost/34291] util.FSUtils(471): Created version file at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1 with version=8 2023-11-30 20:53:19,252 INFO [Listener at localhost/34291] hbase.HBaseTestingUtility(1406): Setting hbase.fs.tmp.dir to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/hbase-staging 2023-11-30 20:53:19,584 INFO [Listener at localhost/34291] metrics.MetricRegistriesLoader(60): Loaded MetricRegistries class org.apache.hadoop.hbase.metrics.impl.MetricRegistriesImpl 2023-11-30 20:53:20,075 INFO [Listener at localhost/34291] client.ConnectionUtils(126): master/jenkins-hbase4:0 server-side Connection retries=3 2023-11-30 20:53:20,107 INFO [Listener at localhost/34291] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-30 20:53:20,108 INFO [Listener at localhost/34291] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-30 20:53:20,108 INFO [Listener at localhost/34291] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-30 20:53:20,108 INFO [Listener at localhost/34291] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-30 20:53:20,108 INFO [Listener at localhost/34291] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-30 20:53:20,265 INFO [Listener at localhost/34291] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.MasterService, hbase.pb.RegionServerStatusService, hbase.pb.LockService, hbase.pb.HbckService, hbase.pb.ClientMetaService, hbase.pb.ClientService, hbase.pb.AdminService 2023-11-30 20:53:20,335 DEBUG [Listener at localhost/34291] util.ClassSize(228): Using Unsafe to estimate memory layout 2023-11-30 20:53:20,425 INFO [Listener at localhost/34291] ipc.NettyRpcServer(120): Bind to /172.31.14.131:43087 2023-11-30 20:53:20,435 INFO [Listener at localhost/34291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-30 20:53:20,437 INFO [Listener at localhost/34291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-30 20:53:20,460 INFO [Listener at localhost/34291] zookeeper.RecoverableZooKeeper(93): Process identifier=master:43087 connecting to ZooKeeper ensemble=127.0.0.1:58095 2023-11-30 20:53:20,504 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:430870x0, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-30 20:53:20,506 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): master:43087-0x1004011c8640000 connected 2023-11-30 20:53:20,540 DEBUG [Listener at localhost/34291] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-30 20:53:20,541 DEBUG [Listener at localhost/34291] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-30 20:53:20,544 DEBUG [Listener at localhost/34291] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-30 20:53:20,552 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=43087 2023-11-30 20:53:20,552 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=43087 2023-11-30 20:53:20,552 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=43087 2023-11-30 20:53:20,553 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=43087 2023-11-30 20:53:20,553 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=43087 2023-11-30 20:53:20,559 INFO [Listener at localhost/34291] master.HMaster(444): hbase.rootdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1, hbase.cluster.distributed=false 2023-11-30 20:53:20,632 INFO [Listener at localhost/34291] client.ConnectionUtils(126): regionserver/jenkins-hbase4:0 server-side Connection retries=3 2023-11-30 20:53:20,632 INFO [Listener at localhost/34291] ipc.RpcExecutor(189): Instantiated default.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-30 20:53:20,632 INFO [Listener at localhost/34291] ipc.RpcExecutor(189): Instantiated priority.RWQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=2, maxQueueLength=30, handlerCount=3 2023-11-30 20:53:20,633 INFO [Listener at localhost/34291] ipc.RWQueueRpcExecutor(107): priority.RWQ.Fifo writeQueues=1 writeHandlers=1 readQueues=1 readHandlers=2 scanQueues=0 scanHandlers=0 2023-11-30 20:53:20,633 INFO [Listener at localhost/34291] ipc.RpcExecutor(189): Instantiated replication.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=3 2023-11-30 20:53:20,633 INFO [Listener at localhost/34291] ipc.RpcExecutor(189): Instantiated metaPriority.FPBQ.Fifo with queueClass=class java.util.concurrent.LinkedBlockingQueue; numCallQueues=1, maxQueueLength=30, handlerCount=1 2023-11-30 20:53:20,638 INFO [Listener at localhost/34291] ipc.RpcServerFactory(64): Creating org.apache.hadoop.hbase.ipc.NettyRpcServer hosting hbase.pb.ClientService, hbase.pb.AdminService 2023-11-30 20:53:20,641 INFO [Listener at localhost/34291] ipc.NettyRpcServer(120): Bind to /172.31.14.131:40365 2023-11-30 20:53:20,643 INFO [Listener at localhost/34291] hfile.BlockCacheFactory(142): Allocating BlockCache size=782.40 MB, blockSize=64 KB 2023-11-30 20:53:20,649 DEBUG [Listener at localhost/34291] mob.MobFileCache(121): MobFileCache enabled with cacheSize=1000, evictPeriods=3600sec, evictRemainRatio=0.5 2023-11-30 20:53:20,650 INFO [Listener at localhost/34291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-30 20:53:20,653 INFO [Listener at localhost/34291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-30 20:53:20,655 INFO [Listener at localhost/34291] zookeeper.RecoverableZooKeeper(93): Process identifier=regionserver:40365 connecting to ZooKeeper ensemble=127.0.0.1:58095 2023-11-30 20:53:20,660 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:403650x0, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=None, state=SyncConnected, path=null 2023-11-30 20:53:20,661 DEBUG [zk-event-processor-pool-0] zookeeper.ZKWatcher(625): regionserver:40365-0x1004011c8640001 connected 2023-11-30 20:53:20,661 DEBUG [Listener at localhost/34291] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-30 20:53:20,662 DEBUG [Listener at localhost/34291] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-30 20:53:20,663 DEBUG [Listener at localhost/34291] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/acl 2023-11-30 20:53:20,664 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=default.FPBQ.Fifo, numCallQueues=1, port=40365 2023-11-30 20:53:20,664 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=priority.RWQ.Fifo.write, numCallQueues=1, port=40365 2023-11-30 20:53:20,668 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=priority.RWQ.Fifo.read, numCallQueues=1, port=40365 2023-11-30 20:53:20,669 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=3 with threadPrefix=replication.FPBQ.Fifo, numCallQueues=1, port=40365 2023-11-30 20:53:20,669 DEBUG [Listener at localhost/34291] ipc.RpcExecutor(311): Started handlerCount=1 with threadPrefix=metaPriority.FPBQ.Fifo, numCallQueues=1, port=40365 2023-11-30 20:53:20,671 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2168): Adding backup master ZNode /hbase/backup-masters/jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:53:20,680 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-30 20:53:20,683 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/backup-masters/jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:53:20,702 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-30 20:53:20,702 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/master 2023-11-30 20:53:20,702 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:53:20,703 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-30 20:53:20,704 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(227): Deleting ZNode for /hbase/backup-masters/jenkins-hbase4.apache.org,43087,1701377599413 from backup master directory 2023-11-30 20:53:20,705 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/master 2023-11-30 20:53:20,708 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/backup-masters/jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:53:20,708 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/backup-masters 2023-11-30 20:53:20,708 WARN [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-30 20:53:20,709 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ActiveMasterManager(237): Registered as active master=jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:53:20,711 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating data MemStoreChunkPool with chunk size 2 MB, max count 352, initial count 0 2023-11-30 20:53:20,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.ChunkCreator(497): Allocating index MemStoreChunkPool with chunk size 204.80 KB, max count 391, initial count 0 2023-11-30 20:53:21,196 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] util.FSUtils(620): Created cluster ID file at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/hbase.id with ID: 8590acf4-ea01-4961-994e-24fb6e91c92e 2023-11-30 20:53:21,238 INFO [master/jenkins-hbase4:0:becomeActiveMaster] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-30 20:53:21,253 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:53:21,291 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ReadOnlyZKClient(139): Connect 0x70bfacde to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:53:21,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@724f2248, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:53:21,346 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(309): Create or load local region for table 'master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'} 2023-11-30 20:53:21,348 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(132): Injected flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000 2023-11-30 20:53:21,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(264): ClientProtocol::create wrong number of arguments, should be hadoop 3.2 or below 2023-11-30 20:53:21,364 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(270): ClientProtocol::create wrong number of arguments, should be hadoop 2.x 2023-11-30 20:53:21,366 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputHelper(279): can not find SHOULD_REPLICATE flag, should be hadoop 2.x java.lang.IllegalArgumentException: No enum constant org.apache.hadoop.fs.CreateFlag.SHOULD_REPLICATE at java.lang.Enum.valueOf(Enum.java:238) at org.apache.hadoop.fs.CreateFlag.valueOf(CreateFlag.java:63) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.loadShouldReplicateFlag(FanOutOneBlockAsyncDFSOutputHelper.java:277) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.(FanOutOneBlockAsyncDFSOutputHelper.java:304) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:139) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-30 20:53:21,369 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(243): No decryptEncryptedDataEncryptionKey method in DFSClient, should be hadoop version with HDFS-12396 java.lang.NoSuchMethodException: org.apache.hadoop.hdfs.DFSClient.decryptEncryptedDataEncryptionKey(org.apache.hadoop.fs.FileEncryptionInfo) at java.lang.Class.getDeclaredMethod(Class.java:2130) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelperWithoutHDFS12396(FanOutOneBlockAsyncDFSOutputSaslHelper.java:182) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.createTransparentCryptoHelper(FanOutOneBlockAsyncDFSOutputSaslHelper.java:241) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper.(FanOutOneBlockAsyncDFSOutputSaslHelper.java:252) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.wal.AsyncFSWALProvider.load(AsyncFSWALProvider.java:140) at org.apache.hadoop.hbase.wal.WALFactory.getProviderClass(WALFactory.java:135) at org.apache.hadoop.hbase.wal.WALFactory.getProvider(WALFactory.java:175) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:202) at org.apache.hadoop.hbase.wal.WALFactory.(WALFactory.java:182) at org.apache.hadoop.hbase.master.region.MasterRegion.create(MasterRegion.java:339) at org.apache.hadoop.hbase.master.region.MasterRegionFactory.create(MasterRegionFactory.java:104) at org.apache.hadoop.hbase.master.HMaster.finishActiveMasterInitialization(HMaster.java:855) at org.apache.hadoop.hbase.master.HMaster.startActiveMasterManager(HMaster.java:2193) at org.apache.hadoop.hbase.master.HMaster.lambda$run$0(HMaster.java:528) at java.lang.Thread.run(Thread.java:750) 2023-11-30 20:53:21,370 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-30 20:53:21,403 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7693): Creating {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='master:store', {NAME => 'proc', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, under table dir hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/data/master/store-tmp 2023-11-30 20:53:21,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:21,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-30 20:53:21,429 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-30 20:53:21,429 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-30 20:53:21,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-30 20:53:21,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-30 20:53:21,430 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-30 20:53:21,430 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-30 20:53:21,431 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegion(191): WALDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/WALs/jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:53:21,453 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C43087%2C1701377599413, suffix=, logDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/WALs/jenkins-hbase4.apache.org,43087,1701377599413, archiveDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/oldWALs, maxLogs=10 2023-11-30 20:53:21,510 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38669,DS-772da0b1-c481-4133-b182-857409ed6522,DISK] 2023-11-30 20:53:21,518 DEBUG [RS-EventLoopGroup-3-2] asyncfs.ProtobufDecoder(123): Hadoop 3.2 and below use unshaded protobuf. java.lang.ClassNotFoundException: org.apache.hadoop.thirdparty.protobuf.MessageLite at java.net.URLClassLoader.findClass(URLClassLoader.java:387) at java.lang.ClassLoader.loadClass(ClassLoader.java:418) at sun.misc.Launcher$AppClassLoader.loadClass(Launcher.java:352) at java.lang.ClassLoader.loadClass(ClassLoader.java:351) at java.lang.Class.forName0(Native Method) at java.lang.Class.forName(Class.java:264) at org.apache.hadoop.hbase.io.asyncfs.ProtobufDecoder.(ProtobufDecoder.java:118) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.processWriteBlockResponse(FanOutOneBlockAsyncDFSOutputHelper.java:340) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$100(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$4.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:424) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:557) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.addListener(DefaultPromise.java:185) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.initialize(FanOutOneBlockAsyncDFSOutputHelper.java:418) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper.access$300(FanOutOneBlockAsyncDFSOutputHelper.java:112) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:476) at org.apache.hadoop.hbase.io.asyncfs.FanOutOneBlockAsyncDFSOutputHelper$5.operationComplete(FanOutOneBlockAsyncDFSOutputHelper.java:471) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListener0(DefaultPromise.java:590) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners0(DefaultPromise.java:583) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListenersNow(DefaultPromise.java:559) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.notifyListeners(DefaultPromise.java:492) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setValue0(DefaultPromise.java:636) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.setSuccess0(DefaultPromise.java:625) at org.apache.hbase.thirdparty.io.netty.util.concurrent.DefaultPromise.trySuccess(DefaultPromise.java:105) at org.apache.hbase.thirdparty.io.netty.channel.DefaultChannelPromise.trySuccess(DefaultChannelPromise.java:84) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.fulfillConnectPromise(AbstractEpollChannel.java:653) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.finishConnect(AbstractEpollChannel.java:691) at org.apache.hbase.thirdparty.io.netty.channel.epoll.AbstractEpollChannel$AbstractEpollUnsafe.epollOutReady(AbstractEpollChannel.java:567) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.processReady(EpollEventLoop.java:499) at org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:407) at org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) at org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) at org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) at java.lang.Thread.run(Thread.java:750) 2023-11-30 20:53:21,580 INFO [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/WALs/jenkins-hbase4.apache.org,43087,1701377599413/jenkins-hbase4.apache.org%2C43087%2C1701377599413.1701377601463 2023-11-30 20:53:21,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38669,DS-772da0b1-c481-4133-b182-857409ed6522,DISK]] 2023-11-30 20:53:21,581 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7854): Opening region: {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:53:21,582 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(866): Instantiated master:store,,1.1595e783b53d99cd5eef43b6debb2682.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:21,585 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7894): checking encryption for 1595e783b53d99cd5eef43b6debb2682 2023-11-30 20:53:21,586 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(7897): checking classloading for 1595e783b53d99cd5eef43b6debb2682 2023-11-30 20:53:21,643 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family proc of region 1595e783b53d99cd5eef43b6debb2682 2023-11-30 20:53:21,649 DEBUG [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc 2023-11-30 20:53:21,673 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1595e783b53d99cd5eef43b6debb2682 columnFamilyName proc 2023-11-30 20:53:21,685 INFO [StoreOpener-1595e783b53d99cd5eef43b6debb2682-1] regionserver.HStore(310): Store=1595e783b53d99cd5eef43b6debb2682/proc, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:21,691 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-30 20:53:21,692 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682 2023-11-30 20:53:21,706 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1055): writing seq id for 1595e783b53d99cd5eef43b6debb2682 2023-11-30 20:53:21,709 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:53:21,710 INFO [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(1072): Opened 1595e783b53d99cd5eef43b6debb2682; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62521197, jitterRate=-0.0683615654706955}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:53:21,711 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] regionserver.HRegion(965): Region open journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-30 20:53:21,712 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.MasterRegionFlusherAndCompactor(122): Constructor flushSize=134217728, flushPerChanges=1000000, flushIntervalMs=900000, compactMin=4 2023-11-30 20:53:21,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(104): Starting the Region Procedure Store, number threads=5 2023-11-30 20:53:21,729 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(608): Starting 5 core workers (bigger of cpus/4 or 16) with max (burst) worker count=50 2023-11-30 20:53:21,731 INFO [master/jenkins-hbase4:0:becomeActiveMaster] region.RegionProcedureStore(255): Starting Region Procedure Store lease recovery... 2023-11-30 20:53:21,733 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(628): Recovered RegionProcedureStore lease in 0 msec 2023-11-30 20:53:21,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(642): Loaded RegionProcedureStore in 32 msec 2023-11-30 20:53:21,765 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.RemoteProcedureDispatcher(96): Instantiated, coreThreads=3 (allowCoreThreadTimeOut=true), queueMaxSize=32, operationDelay=150 2023-11-30 20:53:21,790 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(253): hbase:meta replica znodes: [] 2023-11-30 20:53:21,796 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.RegionServerTracker(124): Starting RegionServerTracker; 0 have existing ServerCrashProcedures, 0 possibly 'live' servers, and 0 'splitting'. 2023-11-30 20:53:21,821 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.BaseLoadBalancer(1082): slop=0.001, systemTablesOnMaster=false 2023-11-30 20:53:21,825 INFO [master/jenkins-hbase4:0:becomeActiveMaster] balancer.StochasticLoadBalancer(253): Loaded config; maxSteps=1000000, runMaxSteps=false, stepsPerRegion=800, maxRunningTime=30000, isByTable=false, CostFunctions=[RegionCountSkewCostFunction, PrimaryRegionCountSkewCostFunction, MoveCostFunction, ServerLocalityCostFunction, RackLocalityCostFunction, TableSkewCostFunction, RegionReplicaHostCostFunction, RegionReplicaRackCostFunction, ReadRequestCostFunction, WriteRequestCostFunction, MemStoreSizeCostFunction, StoreFileCostFunction] , sum of multiplier of cost functions = 0.0 etc. 2023-11-30 20:53:21,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/balancer 2023-11-30 20:53:21,832 INFO [master/jenkins-hbase4:0:becomeActiveMaster] normalizer.RegionNormalizerWorker(118): Normalizer rate limit set to unlimited 2023-11-30 20:53:21,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/normalizer 2023-11-30 20:53:21,841 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:53:21,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/split 2023-11-30 20:53:21,843 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/switch/merge 2023-11-30 20:53:21,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/snapshot-cleanup 2023-11-30 20:53:21,860 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-30 20:53:21,860 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/running 2023-11-30 20:53:21,860 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:53:21,861 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(744): Active/primary master=jenkins-hbase4.apache.org,43087,1701377599413, sessionid=0x1004011c8640000, setting cluster-up flag (Was=false) 2023-11-30 20:53:21,882 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:53:21,890 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/flush-table-proc/acquired, /hbase/flush-table-proc/reached, /hbase/flush-table-proc/abort 2023-11-30 20:53:21,892 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:53:21,898 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:53:21,906 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureUtil(251): Clearing all znodes /hbase/online-snapshot/acquired, /hbase/online-snapshot/reached, /hbase/online-snapshot/abort 2023-11-30 20:53:21,907 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure.ZKProcedureCoordinator(245): Starting controller for procedure member=jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:53:21,910 WARN [master/jenkins-hbase4:0:becomeActiveMaster] snapshot.SnapshotManager(304): Couldn't delete working snapshot directory: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp 2023-11-30 20:53:21,974 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(954): ClusterId : 8590acf4-ea01-4961-994e-24fb6e91c92e 2023-11-30 20:53:21,978 DEBUG [RS:0;jenkins-hbase4:40365] procedure.RegionServerProcedureManagerHost(43): Procedure flush-table-proc initializing 2023-11-30 20:53:21,984 DEBUG [RS:0;jenkins-hbase4:40365] procedure.RegionServerProcedureManagerHost(45): Procedure flush-table-proc initialized 2023-11-30 20:53:21,984 DEBUG [RS:0;jenkins-hbase4:40365] procedure.RegionServerProcedureManagerHost(43): Procedure online-snapshot initializing 2023-11-30 20:53:21,987 DEBUG [RS:0;jenkins-hbase4:40365] procedure.RegionServerProcedureManagerHost(45): Procedure online-snapshot initialized 2023-11-30 20:53:21,990 DEBUG [RS:0;jenkins-hbase4:40365] zookeeper.ReadOnlyZKClient(139): Connect 0x0ed9b448 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:53:21,996 DEBUG [RS:0;jenkins-hbase4:40365] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1e5be3, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:53:21,997 DEBUG [RS:0;jenkins-hbase4:40365] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@421df38, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-30 20:53:22,020 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.ShutdownHook(81): Installed shutdown hook thread: Shutdownhook:RS:0;jenkins-hbase4:40365 2023-11-30 20:53:22,025 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT; InitMetaProcedure table=hbase:meta 2023-11-30 20:53:22,025 INFO [RS:0;jenkins-hbase4:40365] regionserver.RegionServerCoprocessorHost(66): System coprocessor loading is enabled 2023-11-30 20:53:22,025 INFO [RS:0;jenkins-hbase4:40365] regionserver.RegionServerCoprocessorHost(67): Table coprocessor loading is enabled 2023-11-30 20:53:22,025 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1025): About to register with Master. 2023-11-30 20:53:22,028 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(2814): reportForDuty to master=jenkins-hbase4.apache.org,43087,1701377599413 with isa=jenkins-hbase4.apache.org/172.31.14.131:40365, startcode=1701377600631 2023-11-30 20:53:22,034 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_OPEN_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-30 20:53:22,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_CLOSE_REGION-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-30 20:53:22,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-30 20:53:22,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_META_SERVER_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=5, maxPoolSize=5 2023-11-30 20:53:22,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=M_LOG_REPLAY_OPS-master/jenkins-hbase4:0, corePoolSize=10, maxPoolSize=10 2023-11-30 20:53:22,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_MERGE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-30 20:53:22,035 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] executor.ExecutorService(93): Starting executor service name=MASTER_TABLE_OPERATIONS-master/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,036 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.procedure2.CompletedProcedureCleaner; timeout=30000, timestamp=1701377632036 2023-11-30 20:53:22,038 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): log_cleaner Cleaner pool size is 1 2023-11-30 20:53:22,045 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_WRITE_FS_LAYOUT, locked=true; InitMetaProcedure table=hbase:meta 2023-11-30 20:53:22,045 INFO [PEWorker-1] procedure.InitMetaProcedure(71): BOOTSTRAP: creating hbase:meta region 2023-11-30 20:53:22,046 DEBUG [RS:0;jenkins-hbase4:40365] ipc.RpcConnection(122): Using SIMPLE authentication for service=RegionServerStatusService, sasl=false 2023-11-30 20:53:22,050 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveLogCleaner 2023-11-30 20:53:22,051 INFO [PEWorker-1] util.FSTableDescriptors(128): Creating new hbase:meta table descriptor 'hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-30 20:53:22,058 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.replication.master.ReplicationLogCleaner 2023-11-30 20:53:22,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreWALCleaner 2023-11-30 20:53:22,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveProcedureWALCleaner 2023-11-30 20:53:22,059 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.LogCleaner(148): Creating 1 old WALs cleaner threads 2023-11-30 20:53:22,060 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=LogsCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,061 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.DirScanPool(70): hfile_cleaner Cleaner pool size is 2 2023-11-30 20:53:22,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveMasterLocalStoreHFileCleaner 2023-11-30 20:53:22,063 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.HFileLinkCleaner 2023-11-30 20:53:22,066 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.snapshot.SnapshotHFileCleaner 2023-11-30 20:53:22,067 INFO [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.CleanerChore(175): Initialize cleaner=org.apache.hadoop.hbase.master.cleaner.TimeToLiveHFileCleaner 2023-11-30 20:53:22,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(242): Starting for large file=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701377602069,5,FailOnTimeoutGroup] 2023-11-30 20:53:22,071 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] cleaner.HFileCleaner(257): Starting for small files=Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701377602071,5,FailOnTimeoutGroup] 2023-11-30 20:53:22,071 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HFileCleaner, period=600000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,072 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1461): Reopening regions with very high storeFileRefCount is disabled. Provide threshold value > 0 for hbase.regions.recovery.store.file.ref.count to enable it. 2023-11-30 20:53:22,073 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=ReplicationBarrierCleaner, period=43200000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,074 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=SnapshotCleaner, period=1800000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,086 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-30 20:53:22,088 INFO [PEWorker-1] util.FSTableDescriptors(135): Updated hbase:meta table descriptor to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/.tabledesc/.tableinfo.0000000001 2023-11-30 20:53:22,088 INFO [PEWorker-1] regionserver.HRegion(7675): creating {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:meta', {TABLE_ATTRIBUTES => {IS_META => 'true', coprocessor$1 => '|org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint|536870911|'}}, {NAME => 'info', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, {NAME => 'rep_barrier', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '2147483647', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '65536', REPLICATION_SCOPE => '0'}, {NAME => 'table', BLOOMFILTER => 'NONE', IN_MEMORY => 'true', VERSIONS => '3', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1 2023-11-30 20:53:22,103 DEBUG [PEWorker-1] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:22,105 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58231, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins.hfs.0 (auth:SIMPLE), service=RegionServerStatusService 2023-11-30 20:53:22,107 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-30 20:53:22,110 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/info 2023-11-30 20:53:22,111 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-30 20:53:22,113 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:22,113 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-30 20:53:22,117 INFO [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43087] master.ServerManager(388): Registering regionserver=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:22,117 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/rep_barrier 2023-11-30 20:53:22,118 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-30 20:53:22,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:22,119 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-30 20:53:22,122 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/table 2023-11-30 20:53:22,122 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-30 20:53:22,123 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:22,125 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740 2023-11-30 20:53:22,126 DEBUG [PEWorker-1] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740 2023-11-30 20:53:22,130 DEBUG [PEWorker-1] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-30 20:53:22,133 DEBUG [PEWorker-1] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-30 20:53:22,137 DEBUG [PEWorker-1] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:53:22,137 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1598): Config from master: hbase.rootdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1 2023-11-30 20:53:22,137 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1598): Config from master: fs.defaultFS=hdfs://localhost:33413 2023-11-30 20:53:22,137 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1598): Config from master: hbase.master.info.port=-1 2023-11-30 20:53:22,138 INFO [PEWorker-1] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62650834, jitterRate=-0.06642982363700867}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-30 20:53:22,138 DEBUG [PEWorker-1] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-30 20:53:22,138 DEBUG [PEWorker-1] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-30 20:53:22,138 INFO [PEWorker-1] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-30 20:53:22,138 DEBUG [PEWorker-1] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-30 20:53:22,138 DEBUG [PEWorker-1] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-30 20:53:22,138 DEBUG [PEWorker-1] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-30 20:53:22,139 INFO [PEWorker-1] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-30 20:53:22,139 DEBUG [PEWorker-1] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-30 20:53:22,144 DEBUG [RS:0;jenkins-hbase4:40365] zookeeper.ZKUtil(163): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:22,144 WARN [RS:0;jenkins-hbase4:40365] hbase.ZNodeClearer(69): Environment variable HBASE_ZNODE_FILE not set; znodes will not be cleared on crash by start scripts (Longer MTTR!) 2023-11-30 20:53:22,146 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-30 20:53:22,146 INFO [RS:0;jenkins-hbase4:40365] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-30 20:53:22,147 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1951): logDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/WALs/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:22,147 DEBUG [PEWorker-1] procedure.InitMetaProcedure(92): Execute pid=1, state=RUNNABLE:INIT_META_ASSIGN_META, locked=true; InitMetaProcedure table=hbase:meta 2023-11-30 20:53:22,147 INFO [PEWorker-1] procedure.InitMetaProcedure(103): Going to assign meta 2023-11-30 20:53:22,150 INFO [RegionServerTracker-0] master.RegionServerTracker(190): RegionServer ephemeral node created, adding [jenkins-hbase4.apache.org,40365,1701377600631] 2023-11-30 20:53:22,158 DEBUG [RS:0;jenkins-hbase4:40365] zookeeper.ZKUtil(163): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/rs/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:22,159 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN}] 2023-11-30 20:53:22,171 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.Replication(139): Replication stats-in-log period=300 seconds 2023-11-30 20:53:22,174 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN 2023-11-30 20:53:22,176 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=2, ppid=1, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN; state=OFFLINE, location=null; forceNewPlan=false, retain=false 2023-11-30 20:53:22,180 INFO [RS:0;jenkins-hbase4:40365] regionserver.MetricsRegionServerWrapperImpl(154): Computing regionserver metrics every 5000 milliseconds 2023-11-30 20:53:22,197 INFO [RS:0;jenkins-hbase4:40365] regionserver.MemStoreFlusher(125): globalMemStoreLimit=782.4 M, globalMemStoreLimitLowMark=743.3 M, Offheap=false 2023-11-30 20:53:22,201 INFO [RS:0;jenkins-hbase4:40365] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:53:22,201 INFO [RS:0;jenkins-hbase4:40365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,202 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer$CompactionChecker(1840): CompactionChecker runs every PT1S 2023-11-30 20:53:22,209 INFO [RS:0;jenkins-hbase4:40365] hbase.ChoreService(166): Chore ScheduledChore name=CompactedHFilesCleaner, period=100, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,209 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,210 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,210 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,210 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_REGION-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,210 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_CLOSE_META-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,210 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_LOG_REPLAY_OPS-regionserver/jenkins-hbase4:0, corePoolSize=2, maxPoolSize=2 2023-11-30 20:53:22,210 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,210 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_REGION_REPLICA_FLUSH_OPS-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,210 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_REFRESH_PEER-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,211 DEBUG [RS:0;jenkins-hbase4:40365] executor.ExecutorService(93): Starting executor service name=RS_SWITCH_RPC_THROTTLE-regionserver/jenkins-hbase4:0, corePoolSize=1, maxPoolSize=1 2023-11-30 20:53:22,211 INFO [RS:0;jenkins-hbase4:40365] hbase.ChoreService(166): Chore ScheduledChore name=CompactionChecker, period=1000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,212 INFO [RS:0;jenkins-hbase4:40365] hbase.ChoreService(166): Chore ScheduledChore name=MemstoreFlusherChore, period=1000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,212 INFO [RS:0;jenkins-hbase4:40365] hbase.ChoreService(166): Chore ScheduledChore name=nonceCleaner, period=360000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,227 INFO [RS:0;jenkins-hbase4:40365] regionserver.HeapMemoryManager(209): Starting, tuneOn=false 2023-11-30 20:53:22,229 INFO [RS:0;jenkins-hbase4:40365] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,40365,1701377600631-HeapMemoryTunerChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,244 INFO [RS:0;jenkins-hbase4:40365] regionserver.Replication(203): jenkins-hbase4.apache.org,40365,1701377600631 started 2023-11-30 20:53:22,244 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1640): Serving as jenkins-hbase4.apache.org,40365,1701377600631, RpcServer on jenkins-hbase4.apache.org/172.31.14.131:40365, sessionid=0x1004011c8640001 2023-11-30 20:53:22,245 DEBUG [RS:0;jenkins-hbase4:40365] procedure.RegionServerProcedureManagerHost(51): Procedure flush-table-proc starting 2023-11-30 20:53:22,245 DEBUG [RS:0;jenkins-hbase4:40365] flush.RegionServerFlushTableProcedureManager(106): Start region server flush procedure manager jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:22,245 DEBUG [RS:0;jenkins-hbase4:40365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40365,1701377600631' 2023-11-30 20:53:22,245 DEBUG [RS:0;jenkins-hbase4:40365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:22,246 DEBUG [RS:0;jenkins-hbase4:40365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:22,247 DEBUG [RS:0;jenkins-hbase4:40365] procedure.RegionServerProcedureManagerHost(53): Procedure flush-table-proc started 2023-11-30 20:53:22,247 DEBUG [RS:0;jenkins-hbase4:40365] procedure.RegionServerProcedureManagerHost(51): Procedure online-snapshot starting 2023-11-30 20:53:22,247 DEBUG [RS:0;jenkins-hbase4:40365] snapshot.RegionServerSnapshotManager(126): Start Snapshot Manager jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:22,247 DEBUG [RS:0;jenkins-hbase4:40365] procedure.ZKProcedureMemberRpcs(357): Starting procedure member 'jenkins-hbase4.apache.org,40365,1701377600631' 2023-11-30 20:53:22,247 DEBUG [RS:0;jenkins-hbase4:40365] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-30 20:53:22,247 DEBUG [RS:0;jenkins-hbase4:40365] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-30 20:53:22,248 DEBUG [RS:0;jenkins-hbase4:40365] procedure.RegionServerProcedureManagerHost(53): Procedure online-snapshot started 2023-11-30 20:53:22,248 INFO [RS:0;jenkins-hbase4:40365] quotas.RegionServerRpcQuotaManager(63): Quota support disabled 2023-11-30 20:53:22,248 INFO [RS:0;jenkins-hbase4:40365] quotas.RegionServerSpaceQuotaManager(80): Quota support disabled, not starting space quota manager. 2023-11-30 20:53:22,328 DEBUG [jenkins-hbase4:43087] assignment.AssignmentManager(2186): Processing assignQueue; systemServersCount=1, allServersCount=1 2023-11-30 20:53:22,331 INFO [PEWorker-3] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40365,1701377600631, state=OPENING 2023-11-30 20:53:22,338 DEBUG [PEWorker-3] zookeeper.MetaTableLocator(240): hbase:meta region location doesn't exist, create it 2023-11-30 20:53:22,340 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:53:22,341 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-30 20:53:22,344 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=3, ppid=2, state=RUNNABLE; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:53:22,359 INFO [RS:0;jenkins-hbase4:40365] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40365%2C1701377600631, suffix=, logDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/WALs/jenkins-hbase4.apache.org,40365,1701377600631, archiveDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/oldWALs, maxLogs=32 2023-11-30 20:53:22,380 DEBUG [RS-EventLoopGroup-3-2] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38669,DS-772da0b1-c481-4133-b182-857409ed6522,DISK] 2023-11-30 20:53:22,384 INFO [RS:0;jenkins-hbase4:40365] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/WALs/jenkins-hbase4.apache.org,40365,1701377600631/jenkins-hbase4.apache.org%2C40365%2C1701377600631.1701377602363 2023-11-30 20:53:22,388 DEBUG [RS:0;jenkins-hbase4:40365] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38669,DS-772da0b1-c481-4133-b182-857409ed6522,DISK]] 2023-11-30 20:53:22,527 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:22,530 DEBUG [RSProcedureDispatcher-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-30 20:53:22,533 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34146, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-30 20:53:22,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:meta,,1.1588230740 2023-11-30 20:53:22,547 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.WALFactory(158): Instantiating WALProvider of type class org.apache.hadoop.hbase.wal.AsyncFSWALProvider 2023-11-30 20:53:22,551 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(489): WAL configuration: blocksize=256 MB, rollsize=128 MB, prefix=jenkins-hbase4.apache.org%2C40365%2C1701377600631.meta, suffix=.meta, logDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/WALs/jenkins-hbase4.apache.org,40365,1701377600631, archiveDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/oldWALs, maxLogs=32 2023-11-30 20:53:22,568 DEBUG [RS-EventLoopGroup-3-1] asyncfs.FanOutOneBlockAsyncDFSOutputSaslHelper(809): SASL client skipping handshake in unsecured configuration for addr = 127.0.0.1/127.0.0.1, datanodeId = DatanodeInfoWithStorage[127.0.0.1:38669,DS-772da0b1-c481-4133-b182-857409ed6522,DISK] 2023-11-30 20:53:22,573 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(806): New WAL /user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/WALs/jenkins-hbase4.apache.org,40365,1701377600631/jenkins-hbase4.apache.org%2C40365%2C1701377600631.meta.1701377602552.meta 2023-11-30 20:53:22,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] wal.AbstractFSWAL(887): Create new AsyncFSWAL writer with pipeline: [DatanodeInfoWithStorage[127.0.0.1:38669,DS-772da0b1-c481-4133-b182-857409ed6522,DISK]] 2023-11-30 20:53:22,573 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 1588230740, NAME => 'hbase:meta,,1', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:53:22,575 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint with path null and priority 536870911 2023-11-30 20:53:22,591 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(8550): Registered coprocessor service: region=hbase:meta,,1 service=MultiRowMutationService 2023-11-30 20:53:22,595 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint from HTD of hbase:meta successfully. 2023-11-30 20:53:22,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table meta 1588230740 2023-11-30 20:53:22,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:meta,,1.1588230740; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:22,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 1588230740 2023-11-30 20:53:22,601 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 1588230740 2023-11-30 20:53:22,604 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region 1588230740 2023-11-30 20:53:22,606 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/info 2023-11-30 20:53:22,606 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/info 2023-11-30 20:53:22,607 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName info 2023-11-30 20:53:22,608 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:22,608 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family rep_barrier of region 1588230740 2023-11-30 20:53:22,609 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/rep_barrier 2023-11-30 20:53:22,609 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/rep_barrier 2023-11-30 20:53:22,610 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName rep_barrier 2023-11-30 20:53:22,611 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/rep_barrier, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:22,611 INFO [StoreOpener-1588230740-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family table of region 1588230740 2023-11-30 20:53:22,613 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/table 2023-11-30 20:53:22,613 DEBUG [StoreOpener-1588230740-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/table 2023-11-30 20:53:22,614 INFO [StoreOpener-1588230740-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 1588230740 columnFamilyName table 2023-11-30 20:53:22,615 INFO [StoreOpener-1588230740-1] regionserver.HStore(310): Store=1588230740/table, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:22,616 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740 2023-11-30 20:53:22,619 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740 2023-11-30 20:53:22,622 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table hbase:meta descriptor;using region.getMemStoreFlushHeapSize/# of families (42.7 M)) instead. 2023-11-30 20:53:22,625 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 1588230740 2023-11-30 20:53:22,627 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 1588230740; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=70323620, jitterRate=0.047903597354888916}}}, FlushLargeStoresPolicy{flushSizeLowerBound=44739242} 2023-11-30 20:53:22,627 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 1588230740: 2023-11-30 20:53:22,641 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:meta,,1.1588230740, pid=3, masterSystemTime=1701377602520 2023-11-30 20:53:22,661 DEBUG [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:meta,,1.1588230740 2023-11-30 20:53:22,662 INFO [RS_OPEN_META-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:meta,,1.1588230740 2023-11-30 20:53:22,662 INFO [PEWorker-5] zookeeper.MetaTableLocator(228): Setting hbase:meta replicaId=0 location in ZooKeeper as jenkins-hbase4.apache.org,40365,1701377600631, state=OPEN 2023-11-30 20:53:22,668 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/meta-region-server 2023-11-30 20:53:22,669 DEBUG [zk-event-processor-pool-0] master.MetaRegionLocationCache(164): Updating meta znode for path /hbase/meta-region-server: CHANGED 2023-11-30 20:53:22,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=3, resume processing ppid=2 2023-11-30 20:53:22,673 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=3, ppid=2, state=SUCCESS; OpenRegionProcedure 1588230740, server=jenkins-hbase4.apache.org,40365,1701377600631 in 325 msec 2023-11-30 20:53:22,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=2, resume processing ppid=1 2023-11-30 20:53:22,678 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=2, ppid=1, state=SUCCESS; TransitRegionStateProcedure table=hbase:meta, region=1588230740, ASSIGN in 515 msec 2023-11-30 20:53:22,684 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=1, state=SUCCESS; InitMetaProcedure table=hbase:meta in 729 msec 2023-11-30 20:53:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(953): Wait for region servers to report in: status=null, state=RUNNING, startTime=1701377602684, completionTime=-1 2023-11-30 20:53:22,684 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.ServerManager(808): Finished waiting on RegionServer count=1; waited=0ms, expected min=1 server(s), max=1 server(s), master is running 2023-11-30 20:53:22,685 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1527): Joining cluster... 2023-11-30 20:53:22,753 DEBUG [hconnection-0xe181145-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:53:22,757 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:53:22,773 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1539): Number of RegionServers=1 2023-11-30 20:53:22,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$RegionInTransitionChore; timeout=60000, timestamp=1701377662774 2023-11-30 20:53:22,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.TimeoutExecutorThread(81): ADDED pid=-1, state=WAITING_TIMEOUT; org.apache.hadoop.hbase.master.assignment.AssignmentManager$DeadServerMetricRegionChore; timeout=120000, timestamp=1701377722774 2023-11-30 20:53:22,774 INFO [master/jenkins-hbase4:0:becomeActiveMaster] assignment.AssignmentManager(1546): Joined the cluster in 89 msec 2023-11-30 20:53:22,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43087,1701377599413-ClusterStatusChore, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,804 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43087,1701377599413-BalancerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,805 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43087,1701377599413-RegionNormalizerChore, period=300000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,806 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=CatalogJanitor-jenkins-hbase4:43087, period=300000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,807 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=HbckChore-, period=3600000, unit=MILLISECONDS is enabled. 2023-11-30 20:53:22,813 DEBUG [master/jenkins-hbase4:0.Chore.1] janitor.CatalogJanitor(175): 2023-11-30 20:53:22,820 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.TableNamespaceManager(92): Namespace table not found. Creating... 2023-11-30 20:53:22,822 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(2148): Client=null/null create 'hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'} 2023-11-30 20:53:22,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=hbase:namespace 2023-11-30 20:53:22,833 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:53:22,836 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:53:22,860 DEBUG [HFileArchiver-1] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2 2023-11-30 20:53:22,862 DEBUG [HFileArchiver-1] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2 empty. 2023-11-30 20:53:22,863 DEBUG [HFileArchiver-1] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2 2023-11-30 20:53:22,863 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived hbase:namespace regions 2023-11-30 20:53:23,288 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/hbase/namespace/.tabledesc/.tableinfo.0000000001 2023-11-30 20:53:23,290 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(7675): creating {ENCODED => f061586794c0e3921942a081e9bc09d2, NAME => 'hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='hbase:namespace', {NAME => 'info', BLOOMFILTER => 'ROW', IN_MEMORY => 'true', VERSIONS => '10', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', COMPRESSION => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', BLOCKCACHE => 'true', BLOCKSIZE => '8192', REPLICATION_SCOPE => '0'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:53:23,703 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:23,703 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1604): Closing f061586794c0e3921942a081e9bc09d2, disabling compactions & flushes 2023-11-30 20:53:23,703 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:53:23,703 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:53:23,704 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. after waiting 0 ms 2023-11-30 20:53:23,704 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:53:23,704 INFO [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1838): Closed hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:53:23,704 DEBUG [RegionOpenAndInit-hbase:namespace-pool-0] regionserver.HRegion(1558): Region close journal for f061586794c0e3921942a081e9bc09d2: 2023-11-30 20:53:23,709 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:53:23,724 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701377603712"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377603712"}]},"ts":"1701377603712"} 2023-11-30 20:53:23,751 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-30 20:53:23,753 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:53:23,757 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377603753"}]},"ts":"1701377603753"} 2023-11-30 20:53:23,761 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLING in hbase:meta 2023-11-30 20:53:23,770 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f061586794c0e3921942a081e9bc09d2, ASSIGN}] 2023-11-30 20:53:23,772 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=hbase:namespace, region=f061586794c0e3921942a081e9bc09d2, ASSIGN 2023-11-30 20:53:23,774 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=5, ppid=4, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=hbase:namespace, region=f061586794c0e3921942a081e9bc09d2, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:53:23,925 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f061586794c0e3921942a081e9bc09d2, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:23,926 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701377603925"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377603925"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377603925"}]},"ts":"1701377603925"} 2023-11-30 20:53:23,930 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=6, ppid=5, state=RUNNABLE; OpenRegionProcedure f061586794c0e3921942a081e9bc09d2, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:53:24,085 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:24,091 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:53:24,091 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => f061586794c0e3921942a081e9bc09d2, NAME => 'hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:53:24,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table namespace f061586794c0e3921942a081e9bc09d2 2023-11-30 20:53:24,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:24,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for f061586794c0e3921942a081e9bc09d2 2023-11-30 20:53:24,092 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for f061586794c0e3921942a081e9bc09d2 2023-11-30 20:53:24,094 INFO [StoreOpener-f061586794c0e3921942a081e9bc09d2-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family info of region f061586794c0e3921942a081e9bc09d2 2023-11-30 20:53:24,097 DEBUG [StoreOpener-f061586794c0e3921942a081e9bc09d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2/info 2023-11-30 20:53:24,097 DEBUG [StoreOpener-f061586794c0e3921942a081e9bc09d2-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2/info 2023-11-30 20:53:24,098 INFO [StoreOpener-f061586794c0e3921942a081e9bc09d2-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region f061586794c0e3921942a081e9bc09d2 columnFamilyName info 2023-11-30 20:53:24,098 INFO [StoreOpener-f061586794c0e3921942a081e9bc09d2-1] regionserver.HStore(310): Store=f061586794c0e3921942a081e9bc09d2/info, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:24,100 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2 2023-11-30 20:53:24,101 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2 2023-11-30 20:53:24,106 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for f061586794c0e3921942a081e9bc09d2 2023-11-30 20:53:24,110 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:53:24,111 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened f061586794c0e3921942a081e9bc09d2; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72273656, jitterRate=0.07696139812469482}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:53:24,111 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for f061586794c0e3921942a081e9bc09d2: 2023-11-30 20:53:24,113 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2., pid=6, masterSystemTime=1701377604084 2023-11-30 20:53:24,117 DEBUG [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:53:24,117 INFO [RS_OPEN_PRIORITY_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:53:24,118 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=5 updating hbase:meta row=f061586794c0e3921942a081e9bc09d2, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:24,119 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2.","families":{"info":[{"qualifier":"regioninfo","vlen":41,"tag":[],"timestamp":"1701377604118"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377604118"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377604118"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377604118"}]},"ts":"1701377604118"} 2023-11-30 20:53:24,126 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=6, resume processing ppid=5 2023-11-30 20:53:24,127 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=6, ppid=5, state=SUCCESS; OpenRegionProcedure f061586794c0e3921942a081e9bc09d2, server=jenkins-hbase4.apache.org,40365,1701377600631 in 192 msec 2023-11-30 20:53:24,129 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=5, resume processing ppid=4 2023-11-30 20:53:24,130 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=5, ppid=4, state=SUCCESS; TransitRegionStateProcedure table=hbase:namespace, region=f061586794c0e3921942a081e9bc09d2, ASSIGN in 356 msec 2023-11-30 20:53:24,131 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:53:24,131 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"hbase:namespace","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377604131"}]},"ts":"1701377604131"} 2023-11-30 20:53:24,134 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=hbase:namespace, state=ENABLED in hbase:meta 2023-11-30 20:53:24,138 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/namespace 2023-11-30 20:53:24,138 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=4, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=hbase:namespace execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:53:24,140 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/namespace 2023-11-30 20:53:24,140 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:53:24,141 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=4, state=SUCCESS; CreateTableProcedure table=hbase:namespace in 1.3160 sec 2023-11-30 20:53:24,176 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=7, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=default 2023-11-30 20:53:24,206 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-30 20:53:24,225 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=7, state=SUCCESS; CreateNamespaceProcedure, namespace=default in 57 msec 2023-11-30 20:53:24,231 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] procedure2.ProcedureExecutor(1075): Stored pid=8, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=hbase 2023-11-30 20:53:24,256 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-30 20:53:24,275 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=8, state=SUCCESS; CreateNamespaceProcedure, namespace=hbase in 43 msec 2023-11-30 20:53:24,315 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/default 2023-11-30 20:53:24,324 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDataChanged, state=SyncConnected, path=/hbase/namespace/hbase 2023-11-30 20:53:24,325 INFO [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1083): Master has completed initialization 3.616sec 2023-11-30 20:53:24,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster] quotas.MasterQuotaManager(97): Quota support disabled 2023-11-30 20:53:24,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] slowlog.SlowLogMasterService(57): Slow/Large requests logging to system table hbase:slowlog is disabled. Quitting. 2023-11-30 20:53:24,328 INFO [master/jenkins-hbase4:0:becomeActiveMaster] zookeeper.ZKWatcher(269): not a secure deployment, proceeding 2023-11-30 20:53:24,329 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43087,1701377599413-ExpiredMobFileCleanerChore, period=86400, unit=SECONDS is enabled. 2023-11-30 20:53:24,330 INFO [master/jenkins-hbase4:0:becomeActiveMaster] hbase.ChoreService(166): Chore ScheduledChore name=jenkins-hbase4.apache.org,43087,1701377599413-MobCompactionChore, period=604800, unit=SECONDS is enabled. 2023-11-30 20:53:24,340 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster] master.HMaster(1175): Balancer post startup initialization complete, took 0 seconds 2023-11-30 20:53:24,381 DEBUG [Listener at localhost/34291] zookeeper.ReadOnlyZKClient(139): Connect 0x77fd41f4 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:53:24,386 DEBUG [Listener at localhost/34291] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ed63e4c, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:53:24,402 DEBUG [hconnection-0x40c4f23-shared-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:53:24,412 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34164, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:53:24,423 INFO [Listener at localhost/34291] hbase.HBaseTestingUtility(1145): Minicluster is up; activeMaster=jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:53:24,425 DEBUG [Listener at localhost/34291] zookeeper.ReadOnlyZKClient(139): Connect 0x0a11c17b to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:53:24,431 DEBUG [Listener at localhost/34291] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@31f4d39e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:53:24,431 INFO [Listener at localhost/34291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-30 20:53:24,480 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=214, OpenFileDescriptor=505, MaxFileDescriptor=60000, SystemLoadAverage=341, ProcessCount=173, AvailableMemoryMB=7732 2023-11-30 20:53:24,491 DEBUG [Listener at localhost/34291] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:53:24,495 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53448, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:53:24,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-30 20:53:24,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:24,511 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:53:24,513 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:53:24,515 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthly" procId is: 9 2023-11-30 20:53:24,516 DEBUG [HFileArchiver-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129 2023-11-30 20:53:24,517 DEBUG [HFileArchiver-2] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129 empty. 2023-11-30 20:53:24,519 DEBUG [HFileArchiver-2] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129 2023-11-30 20:53:24,519 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthly regions 2023-11-30 20:53:24,525 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-30 20:53:24,631 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-30 20:53:24,833 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-30 20:53:24,937 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-30 20:53:24,940 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(7675): creating {ENCODED => 459120585a3b68683a2916d188707129, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:53:24,952 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:24,953 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1604): Closing 459120585a3b68683a2916d188707129, disabling compactions & flushes 2023-11-30 20:53:24,953 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:24,953 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:24,953 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. after waiting 0 ms 2023-11-30 20:53:24,953 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:24,953 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:24,953 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthly-pool-0] regionserver.HRegion(1558): Region close journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:24,957 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:53:24,959 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701377604959"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377604959"}]},"ts":"1701377604959"} 2023-11-30 20:53:24,962 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-30 20:53:24,964 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:53:24,964 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377604964"}]},"ts":"1701377604964"} 2023-11-30 20:53:24,966 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLING in hbase:meta 2023-11-30 20:53:24,971 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=459120585a3b68683a2916d188707129, ASSIGN}] 2023-11-30 20:53:24,973 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=459120585a3b68683a2916d188707129, ASSIGN 2023-11-30 20:53:24,975 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=10, ppid=9, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=459120585a3b68683a2916d188707129, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:53:25,126 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=459120585a3b68683a2916d188707129, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:25,127 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701377605126"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377605126"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377605126"}]},"ts":"1701377605126"} 2023-11-30 20:53:25,130 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=11, ppid=10, state=RUNNABLE; OpenRegionProcedure 459120585a3b68683a2916d188707129, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:53:25,135 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-30 20:53:25,284 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:25,290 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:25,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 459120585a3b68683a2916d188707129, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:53:25,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 459120585a3b68683a2916d188707129 2023-11-30 20:53:25,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:25,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 459120585a3b68683a2916d188707129 2023-11-30 20:53:25,291 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 459120585a3b68683a2916d188707129 2023-11-30 20:53:25,295 INFO [StoreOpener-459120585a3b68683a2916d188707129-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 459120585a3b68683a2916d188707129 2023-11-30 20:53:25,298 DEBUG [StoreOpener-459120585a3b68683a2916d188707129-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:25,298 DEBUG [StoreOpener-459120585a3b68683a2916d188707129-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:25,301 INFO [StoreOpener-459120585a3b68683a2916d188707129-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 459120585a3b68683a2916d188707129 columnFamilyName family1 2023-11-30 20:53:25,304 INFO [StoreOpener-459120585a3b68683a2916d188707129-1] regionserver.HStore(310): Store=459120585a3b68683a2916d188707129/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:25,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129 2023-11-30 20:53:25,307 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129 2023-11-30 20:53:25,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 459120585a3b68683a2916d188707129 2023-11-30 20:53:25,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:53:25,317 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 459120585a3b68683a2916d188707129; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69958348, jitterRate=0.042460620403289795}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:53:25,317 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:25,318 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129., pid=11, masterSystemTime=1701377605284 2023-11-30 20:53:25,321 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:25,321 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:25,322 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=10 updating hbase:meta row=459120585a3b68683a2916d188707129, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:25,323 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701377605322"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377605322"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377605322"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377605322"}]},"ts":"1701377605322"} 2023-11-30 20:53:25,329 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=11, resume processing ppid=10 2023-11-30 20:53:25,331 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=11, ppid=10, state=SUCCESS; OpenRegionProcedure 459120585a3b68683a2916d188707129, server=jenkins-hbase4.apache.org,40365,1701377600631 in 196 msec 2023-11-30 20:53:25,333 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=10, resume processing ppid=9 2023-11-30 20:53:25,334 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=10, ppid=9, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=459120585a3b68683a2916d188707129, ASSIGN in 359 msec 2023-11-30 20:53:25,335 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:53:25,335 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377605335"}]},"ts":"1701377605335"} 2023-11-30 20:53:25,337 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthly, state=ENABLED in hbase:meta 2023-11-30 20:53:25,349 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=9, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:53:25,351 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=9, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 842 msec 2023-11-30 20:53:25,637 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=9 2023-11-30 20:53:25,638 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthly, procId: 9 completed 2023-11-30 20:53:25,659 DEBUG [hconnection-0x36875720-metaLookup-shared--pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:53:25,662 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34170, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:53:25,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:25,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:25,819 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:25,819 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:25,819 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:25,819 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:25,820 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:25,820 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:25,823 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:25,823 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:25,823 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:25,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:25,824 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:25,824 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:25,824 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:25,824 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:25,825 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:25,825 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:25,827 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:25,827 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:25,828 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:25,828 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:25,829 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:25,829 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:25,830 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:25,830 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:25,831 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-30 20:53:25,984 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130260eee16c9134c7cb05521b1bac57372 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130260eee16c9134c7cb05521b1bac57372 2023-11-30 20:53:26,000 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/3153852aebf54579802cd2f6c7a8cf60 2023-11-30 20:53:26,011 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/3153852aebf54579802cd2f6c7a8cf60 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3153852aebf54579802cd2f6c7a8cf60 2023-11-30 20:53:26,020 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3153852aebf54579802cd2f6c7a8cf60, entries=1000, sequenceid=5, filesize=175.8 K 2023-11-30 20:53:26,024 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 193ms, sequenceid=5, compaction requested=false 2023-11-30 20:53:26,025 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:26,028 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:26,028 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:26,028 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:26,029 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:26,029 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,029 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:26,029 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:26,033 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,033 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:26,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:26,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:26,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:26,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:26,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:26,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@129fbb5e[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:26,036 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:26,036 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,039 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,039 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:26,039 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:26,039 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:26,039 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,039 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:26,042 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:26,042 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,042 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:26,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:26,043 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:26,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:26,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:26,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:26,048 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:26,048 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:26,048 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:26,048 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:26,048 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,048 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:26,052 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,052 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:26,052 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:26,052 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:26,053 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:26,053 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:26,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,055 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:26,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,064 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,064 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:26,064 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:26,064 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:26,064 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:26,064 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,064 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,064 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,064 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,064 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,064 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:26,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:26,065 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:26,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:26,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:26,067 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:26,067 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:26,167 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:26,172 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:26,182 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:26,185 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:26,186 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,186 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:26,186 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:26,186 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:26,186 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:26,187 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,187 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,191 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:26,191 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,191 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:26,191 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:26,192 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:26,192 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:26,192 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,192 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:26,193 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,193 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,193 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-30 20:53:26,193 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:26,193 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:26,194 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:26,194 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:26,194 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:26,194 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:26,194 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:26,194 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:26,194 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-30 20:53:26,622 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112842c831bb8fd14b9da059b2535bd1eb52 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112842c831bb8fd14b9da059b2535bd1eb52 2023-11-30 20:53:27,035 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/bd16ead237c54171b24b35e0af8e8cc8 2023-11-30 20:53:27,046 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/bd16ead237c54171b24b35e0af8e8cc8 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/bd16ead237c54171b24b35e0af8e8cc8 2023-11-30 20:53:27,054 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/bd16ead237c54171b24b35e0af8e8cc8, entries=1, sequenceid=9, filesize=5.0 K 2023-11-30 20:53:27,056 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 862ms, sequenceid=9, compaction requested=false 2023-11-30 20:53:27,056 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:27,056 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:27,056 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:27,056 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:27,057 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,057 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:27,057 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:27,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,060 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:27,060 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:27,061 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:27,061 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:27,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:27,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,063 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:27,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:27,063 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1e62dab8[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:27,063 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:27,063 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,065 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,065 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,065 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,065 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:27,065 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:27,065 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:27,065 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,065 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:27,068 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:27,068 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,068 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:27,068 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:27,068 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:27,069 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:27,072 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:27,072 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:27,072 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:27,072 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:27,072 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,073 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:27,075 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,075 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:27,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,075 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:27,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:27,076 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:27,076 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:27,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:27,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,078 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:27,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,080 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,084 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,084 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:27,084 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,084 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,084 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,084 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,084 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:27,084 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,084 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:27,084 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:27,084 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,084 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:27,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:27,085 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:27,085 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:27,085 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:27,085 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:27,085 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:27,185 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:27,187 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:27,196 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:27,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:27,198 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,199 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:27,199 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:27,199 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:27,199 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:27,200 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,200 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,202 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,202 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:27,202 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:27,202 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,202 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:27,203 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,203 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:27,204 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,204 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-30 20:53:27,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,204 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:27,204 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:27,205 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:27,205 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:27,205 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:27,205 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:27,205 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:27,205 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:27,634 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201505438139ad64a6ba1db4391d9fe8b8c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201505438139ad64a6ba1db4391d9fe8b8c 2023-11-30 20:53:27,647 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/fc1876f87822434e8ef6a1ec294d7c7d 2023-11-30 20:53:27,657 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/fc1876f87822434e8ef6a1ec294d7c7d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/fc1876f87822434e8ef6a1ec294d7c7d 2023-11-30 20:53:27,666 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/fc1876f87822434e8ef6a1ec294d7c7d, entries=1, sequenceid=13, filesize=5.0 K 2023-11-30 20:53:27,668 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 463ms, sequenceid=13, compaction requested=true 2023-11-30 20:53:27,668 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:27,668 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:27,668 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:27,669 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:27,669 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,669 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:27,669 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:27,672 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,672 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:27,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:27,672 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:27,672 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:27,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:27,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:27,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:27,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@26208e43[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:27,675 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:27,675 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,676 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,676 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,677 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:27,677 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:27,677 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:27,677 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,677 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:27,679 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,679 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:27,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:27,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:27,679 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:27,679 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:27,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:27,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:27,681 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:27,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:27,684 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:27,684 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:27,684 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:27,684 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:27,684 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,684 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:27,688 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,688 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:27,688 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:27,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:27,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:27,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:27,690 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,692 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,693 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,698 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,698 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,698 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,698 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,698 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,698 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,698 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:27,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:27,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:27,699 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:27,699 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:27,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-30 20:53:27,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:27,699 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:27,699 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:27,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:27,699 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,700 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:27,700 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:27,800 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:27,802 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:27,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:27,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:27,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,814 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:27,814 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:27,814 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:27,814 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:27,815 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,815 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,817 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:27,817 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,817 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:27,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:27,817 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,818 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:27,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,818 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,819 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,819 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-30 20:53:27,819 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:27,819 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:27,820 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:27,820 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:27,820 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:27,820 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:27,820 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:27,821 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:27,847 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055712d64095db406dbb171b70188603ec to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512055712d64095db406dbb171b70188603ec 2023-11-30 20:53:27,868 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/c9bf214655594726b7aec649afe3daf1 2023-11-30 20:53:27,879 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/c9bf214655594726b7aec649afe3daf1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/c9bf214655594726b7aec649afe3daf1 2023-11-30 20:53:27,891 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/c9bf214655594726b7aec649afe3daf1, entries=1, sequenceid=17, filesize=5.0 K 2023-11-30 20:53:27,892 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 71ms, sequenceid=17, compaction requested=true 2023-11-30 20:53:27,893 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:27,893 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:27,893 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:27,894 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:27,894 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,895 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:27,895 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:27,898 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,898 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:27,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,899 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:27,899 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:27,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:27,901 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:27,902 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2a35762d[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:27,902 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:27,902 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,904 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,904 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:27,904 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:27,905 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,905 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:27,907 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:27,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:27,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:27,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:27,911 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:27,911 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:27,912 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:27,912 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:27,912 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,912 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:27,916 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,916 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,917 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:27,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:27,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:27,917 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,919 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:27,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,925 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,925 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,925 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:27,925 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,926 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:27,926 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:27,926 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:27,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:27,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:27,926 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,926 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:27,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:27,926 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,926 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:27,927 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:27,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:27,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:27,927 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:28,027 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:28,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:28,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:28,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:28,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,040 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:28,040 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:28,040 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:28,040 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:28,041 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,041 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,043 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:28,043 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:28,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:28,043 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,043 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:28,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,044 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:28,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,045 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,045 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-30 20:53:28,045 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,045 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:28,045 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:28,046 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:28,047 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:28,047 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:28,047 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:28,047 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:28,047 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:28,125 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:53:28,179 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:meta' 2023-11-30 20:53:28,181 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'hbase:namespace' 2023-11-30 20:53:28,472 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512287dd5a42af48f46beb958d1a1c869bc04 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512287dd5a42af48f46beb958d1a1c869bc04 2023-11-30 20:53:28,887 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/4eb9dbaef12f4d35be012faeb57497a1 2023-11-30 20:53:28,896 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/4eb9dbaef12f4d35be012faeb57497a1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/4eb9dbaef12f4d35be012faeb57497a1 2023-11-30 20:53:28,905 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/4eb9dbaef12f4d35be012faeb57497a1, entries=1, sequenceid=21, filesize=5.0 K 2023-11-30 20:53:28,906 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 859ms, sequenceid=21, compaction requested=true 2023-11-30 20:53:28,906 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:28,907 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:28,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:28,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,909 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:28,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:28,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:28,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:28,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:28,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:28,912 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@451f7d7e[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:28,912 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:28,912 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,914 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,914 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,914 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:28,914 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:28,914 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:28,914 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,915 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:28,917 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,917 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:28,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:28,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:28,917 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:28,918 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:28,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:28,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:28,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:28,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:28,922 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:28,922 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:28,922 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:28,922 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:28,922 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,922 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:28,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:28,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:28,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:28,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:28,925 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:28,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:28,925 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:28,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,927 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:28,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:28,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:28,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:28,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:28,931 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:28,931 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:28,932 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:28,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:28,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:28,932 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:28,932 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,932 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:28,932 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:28,932 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:29,032 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:29,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:29,043 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:29,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:29,045 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,045 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:29,045 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:29,046 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:29,046 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:29,046 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,046 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,048 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:29,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:29,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:29,049 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,049 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:29,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,049 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:29,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,050 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,050 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-30 20:53:29,050 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,051 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:29,051 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:29,051 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:29,051 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:29,051 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:29,051 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:29,051 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:29,051 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:29,475 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512318ca98f06f60e4c0aa63ec9c40a295682 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318ca98f06f60e4c0aa63ec9c40a295682 2023-11-30 20:53:29,579 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-30 20:53:29,580 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint Metrics about HBase RegionObservers 2023-11-30 20:53:29,886 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/d451a04752b04a15aaeb25809e1bf8ff 2023-11-30 20:53:29,897 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/d451a04752b04a15aaeb25809e1bf8ff as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/d451a04752b04a15aaeb25809e1bf8ff 2023-11-30 20:53:29,906 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/d451a04752b04a15aaeb25809e1bf8ff, entries=1, sequenceid=25, filesize=5.0 K 2023-11-30 20:53:29,908 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 857ms, sequenceid=25, compaction requested=true 2023-11-30 20:53:29,908 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:29,908 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:29,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:29,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:29,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:29,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:29,913 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,913 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:29,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:29,914 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,914 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:29,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:29,914 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:29,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:29,916 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:29,917 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d20d87f[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:29,917 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:29,917 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,919 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,919 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,919 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:29,919 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:29,919 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:29,919 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,919 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:29,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,921 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:29,921 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:29,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:29,921 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:29,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:29,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:29,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:29,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,925 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,926 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:29,926 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:29,926 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:29,927 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:29,927 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:29,927 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,927 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:29,929 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,929 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:29,929 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:29,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:29,930 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:29,930 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:29,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,933 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,933 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,934 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,937 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,937 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,937 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:29,937 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:29,937 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,937 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:29,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:29,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:29,937 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:29,937 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:29,937 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:29,938 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,938 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:29,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:29,938 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,938 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:29,938 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:29,939 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:30,039 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:30,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:30,048 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:30,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:30,051 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,051 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:30,051 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:30,051 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:30,051 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:30,052 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,052 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,054 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:30,054 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,054 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:30,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:30,054 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,054 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:30,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,055 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:30,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,056 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,056 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-30 20:53:30,056 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,057 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:30,057 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:30,057 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:30,057 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:30,057 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:30,057 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:30,057 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:30,058 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:30,481 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101118bfbfc4ee842e1a74481666cce232f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101118bfbfc4ee842e1a74481666cce232f 2023-11-30 20:53:30,490 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/dba2482f2c1f47b29f247475889ba75b 2023-11-30 20:53:30,499 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/dba2482f2c1f47b29f247475889ba75b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/dba2482f2c1f47b29f247475889ba75b 2023-11-30 20:53:30,508 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/dba2482f2c1f47b29f247475889ba75b, entries=1, sequenceid=29, filesize=5.0 K 2023-11-30 20:53:30,510 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 452ms, sequenceid=29, compaction requested=true 2023-11-30 20:53:30,510 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:30,510 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:30,511 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:30,511 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:30,511 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,511 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:30,511 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:30,516 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,516 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:30,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,517 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:30,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:30,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:30,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,519 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:30,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:30,520 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6f50050e[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:30,520 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:30,520 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,522 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,523 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,523 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:30,523 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:30,523 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:30,523 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,523 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:30,525 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:30,525 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,525 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:30,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:30,525 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:30,525 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:30,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:30,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:30,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:30,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:30,528 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:30,528 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:30,528 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:30,529 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:30,529 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,529 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:30,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:30,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:30,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:30,531 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:30,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,533 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:30,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,537 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,537 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,537 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:30,537 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,537 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:30,537 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:30,537 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:30,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:30,537 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-30 20:53:30,537 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,537 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:30,537 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,537 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:30,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:30,538 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:30,539 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:30,539 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:30,639 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:30,640 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:30,649 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:30,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:30,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,651 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:30,651 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:30,652 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:30,652 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:30,652 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,652 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,655 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:30,655 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:30,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:30,655 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:30,655 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:30,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:30,657 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,657 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,657 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-30 20:53:30,657 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:30,657 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:30,657 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:30,658 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:30,658 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:30,658 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:30,658 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:30,658 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:30,658 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:30,680 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010323688193287343e7aae60447b88688b1 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010323688193287343e7aae60447b88688b1 2023-11-30 20:53:31,091 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/3b603a6f676b4edb898b1dcbcadc9686 2023-11-30 20:53:31,099 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/3b603a6f676b4edb898b1dcbcadc9686 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3b603a6f676b4edb898b1dcbcadc9686 2023-11-30 20:53:31,107 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3b603a6f676b4edb898b1dcbcadc9686, entries=1, sequenceid=33, filesize=5.0 K 2023-11-30 20:53:31,109 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 451ms, sequenceid=33, compaction requested=true 2023-11-30 20:53:31,109 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:31,109 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:31,109 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:31,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:31,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:31,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:31,112 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,112 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:31,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:31,113 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,113 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:31,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:31,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:31,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e5582d7[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:31,115 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:31,115 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,116 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,117 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:31,117 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:31,117 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,117 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:31,117 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:31,118 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,118 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:31,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:31,119 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:31,119 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:31,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:31,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:31,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:31,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:31,124 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:31,124 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:31,124 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:31,124 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:31,124 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,124 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:31,127 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,127 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:31,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:31,127 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,127 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:31,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,128 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:31,128 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:31,129 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,130 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,130 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:31,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,131 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,134 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,134 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:31,134 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:31,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:31,134 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:31,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:31,134 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:31,134 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:31,134 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,135 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:31,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:31,135 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,135 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,135 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,135 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,135 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:31,136 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:31,236 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:31,238 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:31,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:31,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:31,249 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,249 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:31,249 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:31,249 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:31,249 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:31,250 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,250 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,252 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:31,252 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,252 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:31,252 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:31,252 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,253 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:31,253 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,253 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:31,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,254 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,254 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-30 20:53:31,254 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,254 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:31,254 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:31,254 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:31,255 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:31,255 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:31,255 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:31,255 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:31,255 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:31,676 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b2fdaeddd0e24d6eae7a78d9c0330a4d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20150907b2fdaeddd0e24d6eae7a78d9c0330a4d 2023-11-30 20:53:31,686 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/5fe6c030803b4eaab1ddc1c064470050 2023-11-30 20:53:31,695 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/5fe6c030803b4eaab1ddc1c064470050 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/5fe6c030803b4eaab1ddc1c064470050 2023-11-30 20:53:31,702 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/5fe6c030803b4eaab1ddc1c064470050, entries=1, sequenceid=37, filesize=5.0 K 2023-11-30 20:53:31,703 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 448ms, sequenceid=37, compaction requested=true 2023-11-30 20:53:31,703 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:31,703 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:31,703 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:31,704 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:31,704 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,704 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:31,704 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:31,706 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,706 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:31,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:31,707 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,707 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:31,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:31,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:31,709 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@501ff6ee[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:31,709 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:31,709 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,711 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:31,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:31,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:31,712 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,712 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:31,713 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:31,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,713 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:31,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:31,713 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:31,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:31,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:31,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:31,717 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:31,718 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:31,718 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:31,718 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,718 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:31,720 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,720 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:31,720 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:31,720 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:31,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:31,721 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:31,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,722 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:31,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,730 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,730 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:31,730 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,730 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:31,730 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:31,730 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:31,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:31,731 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:31,731 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:31,731 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,732 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,732 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:31,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:31,732 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,733 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,733 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:31,733 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:31,833 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:31,835 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:31,843 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:31,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthly was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:31,845 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,845 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:31,845 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:31,846 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' 2023-11-30 20:53:31,846 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthly', kicking off acquire phase on members. 2023-11-30 20:53:31,846 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,846 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,848 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,848 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:31,848 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:31,848 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:31,848 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:31,848 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:31,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,849 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:31,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,850 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,850 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthly is still present, removing 2023-11-30 20:53:31,850 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:31,850 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' with timeout 60000ms 2023-11-30 20:53:31,850 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:31,851 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'acquire' stage 2023-11-30 20:53:31,851 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:31,851 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:31,851 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:31,851 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. started... 2023-11-30 20:53:31,852 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 459120585a3b68683a2916d188707129 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:32,273 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511202129f02665884ea3ab610591841ab1bc to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202129f02665884ea3ab610591841ab1bc 2023-11-30 20:53:32,687 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/ba3460ecab944c4ba13f5ca855f9b431 2023-11-30 20:53:32,695 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/ba3460ecab944c4ba13f5ca855f9b431 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/ba3460ecab944c4ba13f5ca855f9b431 2023-11-30 20:53:32,703 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/ba3460ecab944c4ba13f5ca855f9b431, entries=1, sequenceid=41, filesize=5.0 K 2023-11-30 20:53:32,704 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 459120585a3b68683a2916d188707129 in 852ms, sequenceid=41, compaction requested=true 2023-11-30 20:53:32,704 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:32,704 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:32,705 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:32,705 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:32,705 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,705 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally acquired 2023-11-30 20:53:32,705 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthly) in zk 2023-11-30 20:53:32,707 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,707 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:32,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:32,708 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,708 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:32,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:32,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' on coordinator 2023-11-30 20:53:32,710 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b372fb2[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:32,710 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' starting 'in-barrier' execution. 2023-11-30 20:53:32,710 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,711 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,711 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,712 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' received 'reached' from coordinator. 2023-11-30 20:53:32,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' locally completed 2023-11-30 20:53:32,712 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,712 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:32,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:32,714 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' has notified controller of completion 2023-11-30 20:53:32,714 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,714 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:32,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:32,714 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthly' completed. 2023-11-30 20:53:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:32,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:32,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:32,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthly', counting down latch. Waiting for 0 more 2023-11-30 20:53:32,718 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthly' execution completed 2023-11-30 20:53:32,718 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:32,718 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:32,718 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,718 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:32,720 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,720 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:32,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,721 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:32,721 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,721 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:32,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,723 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:32,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,727 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,727 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:32,727 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:32,727 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:32,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthly' 2023-11-30 20:53:32,727 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:32,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:32,727 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:32,727 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,728 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly because node does not exist (not an error) 2023-11-30 20:53:32,728 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:32,728 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,728 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,728 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,728 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthly'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:32,729 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:32,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:32,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:32,829 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:32,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:32,838 DEBUG [Listener at localhost/34291] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-30 20:53:32,841 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35904, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-30 20:53:32,842 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:32,855 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-30 20:53:32,856 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=12, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-30 20:53:32,858 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:53:32,858 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=12, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378212858 2023-11-30 20:53:32,859 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:53:32,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-30 20:53:32,863 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:32,865 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x5072fb05 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:53:32,869 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5afc7815, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:53:32,871 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:33,750 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601031eb173d1d51f4dc496bf87a369ff31bb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201601031eb173d1d51f4dc496bf87a369ff31bb 2023-11-30 20:53:33,752 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:33,771 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:53:33,772 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44302, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:53:33,783 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:53:33,785 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35912, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:53:33,818 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3e1c315d11c4428aa94e1d11ba0c8695 first=Optional[r3] last=Optional[r6] 2023-11-30 20:53:33,831 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3e1c315d11c4428aa94e1d11ba0c8695}] 2023-11-30 20:53:33,846 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3e1c315d11c4428aa94e1d11ba0c8695 for inclusion in 459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:33,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-30 20:53:33,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:53:33,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:33,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/3e1c315d11c4428aa94e1d11ba0c8695 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c7bdv7904lhkf1jl3u7pgh7hssgbme28q3ctn16lhuejj2kg70rjl89cstc8derp/family1/3e1c315d11c4428aa94e1d11ba0c8695 2023-11-30 20:53:33,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c7bdv7904lhkf1jl3u7pgh7hssgbme28q3ctn16lhuejj2kg70rjl89cstc8derp/family1/3e1c315d11c4428aa94e1d11ba0c8695 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/808c917efa7746df8406133ced12bd0f_SeqId_44_ 2023-11-30 20:53:33,859 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c7bdv7904lhkf1jl3u7pgh7hssgbme28q3ctn16lhuejj2kg70rjl89cstc8derp/family1/3e1c315d11c4428aa94e1d11ba0c8695 into 459120585a3b68683a2916d188707129/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/808c917efa7746df8406133ced12bd0f_SeqId_44_ - updating store file list. 2023-11-30 20:53:33,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/808c917efa7746df8406133ced12bd0f_SeqId_44_ into 459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:33,865 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c7bdv7904lhkf1jl3u7pgh7hssgbme28q3ctn16lhuejj2kg70rjl89cstc8derp/family1/3e1c315d11c4428aa94e1d11ba0c8695 into 459120585a3b68683a2916d188707129/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/808c917efa7746df8406133ced12bd0f_SeqId_44_) 2023-11-30 20:53:33,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__c7bdv7904lhkf1jl3u7pgh7hssgbme28q3ctn16lhuejj2kg70rjl89cstc8derp/family1/3e1c315d11c4428aa94e1d11ba0c8695 2023-11-30 20:53:33,868 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-30 20:53:33,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51357 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-30 20:53:33,875 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): 459120585a3b68683a2916d188707129/family1 is initiating minor compaction 2023-11-30 20:53:33,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@d15f45b; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:33,876 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 459120585a3b68683a2916d188707129/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:33,877 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/bd16ead237c54171b24b35e0af8e8cc8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/fc1876f87822434e8ef6a1ec294d7c7d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/c9bf214655594726b7aec649afe3daf1, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/4eb9dbaef12f4d35be012faeb57497a1, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/d451a04752b04a15aaeb25809e1bf8ff, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/dba2482f2c1f47b29f247475889ba75b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3b603a6f676b4edb898b1dcbcadc9686, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/5fe6c030803b4eaab1ddc1c064470050, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/ba3460ecab944c4ba13f5ca855f9b431, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/808c917efa7746df8406133ced12bd0f_SeqId_44_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp, totalSize=50.2 K 2023-11-30 20:53:33,877 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting bd16ead237c54171b24b35e0af8e8cc8, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-30 20:53:33,878 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting fc1876f87822434e8ef6a1ec294d7c7d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-30 20:53:33,878 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting c9bf214655594726b7aec649afe3daf1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-30 20:53:33,878 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 4eb9dbaef12f4d35be012faeb57497a1, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-30 20:53:33,878 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting d451a04752b04a15aaeb25809e1bf8ff, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-30 20:53:33,878 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting dba2482f2c1f47b29f247475889ba75b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-30 20:53:33,878 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 3b603a6f676b4edb898b1dcbcadc9686, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-30 20:53:33,878 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 5fe6c030803b4eaab1ddc1c064470050, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-30 20:53:33,878 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting ba3460ecab944c4ba13f5ca855f9b431, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-30 20:53:33,878 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 808c917efa7746df8406133ced12bd0f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-30 20:53:33,892 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:33,894 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:33,900 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512287dd5a42af48f46beb958d1a1c869bc04 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512287dd5a42af48f46beb958d1a1c869bc04 2023-11-30 20:53:33,902 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318ca98f06f60e4c0aa63ec9c40a295682 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512318ca98f06f60e4c0aa63ec9c40a295682 2023-11-30 20:53:33,904 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101118bfbfc4ee842e1a74481666cce232f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20160101118bfbfc4ee842e1a74481666cce232f 2023-11-30 20:53:33,906 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010323688193287343e7aae60447b88688b1 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2016010323688193287343e7aae60447b88688b1 2023-11-30 20:53:33,906 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 4 expired mob files are deleted 2023-11-30 20:53:33,906 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-30 20:53:33,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:33,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:33,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:33,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:33,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:33,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:33,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:33,907 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:33,942 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 459120585a3b68683a2916d188707129#family1#compaction#10 average throughput is 0.29 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:53:34,773 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/6fe8dc12538e4a3a8d2fa717f1fa2eb6 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/6fe8dc12538e4a3a8d2fa717f1fa2eb6 2023-11-30 20:53:34,788 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 459120585a3b68683a2916d188707129/family1 of 459120585a3b68683a2916d188707129 into 6fe8dc12538e4a3a8d2fa717f1fa2eb6(size=6.6 K), total size for store is 182.5 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:53:34,788 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:34,790 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129., storeName=family1, fileCount=10, fileSize=50.2 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.5 K), priority=2, time=1701377613874; duration=0sec 2023-11-30 20:53:34,791 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:34,802 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205c99996e46992411d96a5f108bbae819d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151205c99996e46992411d96a5f108bbae819d 2023-11-30 20:53:34,804 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:34,821 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/bd16ead237c54171b24b35e0af8e8cc8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/fc1876f87822434e8ef6a1ec294d7c7d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/c9bf214655594726b7aec649afe3daf1, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/4eb9dbaef12f4d35be012faeb57497a1, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/d451a04752b04a15aaeb25809e1bf8ff, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/dba2482f2c1f47b29f247475889ba75b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3b603a6f676b4edb898b1dcbcadc9686, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/5fe6c030803b4eaab1ddc1c064470050, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/ba3460ecab944c4ba13f5ca855f9b431, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/808c917efa7746df8406133ced12bd0f_SeqId_44_] to archive 2023-11-30 20:53:34,823 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:34,826 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/bd16ead237c54171b24b35e0af8e8cc8 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/bd16ead237c54171b24b35e0af8e8cc8 2023-11-30 20:53:34,836 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/fc1876f87822434e8ef6a1ec294d7c7d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/fc1876f87822434e8ef6a1ec294d7c7d 2023-11-30 20:53:34,838 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/c9bf214655594726b7aec649afe3daf1 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/c9bf214655594726b7aec649afe3daf1 2023-11-30 20:53:34,841 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/4eb9dbaef12f4d35be012faeb57497a1 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/4eb9dbaef12f4d35be012faeb57497a1 2023-11-30 20:53:34,845 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/d451a04752b04a15aaeb25809e1bf8ff to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/d451a04752b04a15aaeb25809e1bf8ff 2023-11-30 20:53:34,847 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/dba2482f2c1f47b29f247475889ba75b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/dba2482f2c1f47b29f247475889ba75b 2023-11-30 20:53:34,848 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a400b541fce14d9e9705ace6e046a52f first=Optional[r00] last=Optional[r2] 2023-11-30 20:53:34,849 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a400b541fce14d9e9705ace6e046a52f}] 2023-11-30 20:53:34,850 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3b603a6f676b4edb898b1dcbcadc9686 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3b603a6f676b4edb898b1dcbcadc9686 2023-11-30 20:53:34,853 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a400b541fce14d9e9705ace6e046a52f for inclusion in 459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:34,854 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/5fe6c030803b4eaab1ddc1c064470050 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/5fe6c030803b4eaab1ddc1c064470050 2023-11-30 20:53:34,858 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/ba3460ecab944c4ba13f5ca855f9b431 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/ba3460ecab944c4ba13f5ca855f9b431 2023-11-30 20:53:34,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-30 20:53:34,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:53:34,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:34,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/a400b541fce14d9e9705ace6e046a52f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mqtht5la4iesud6t4v5bkd9ojpc9bjealejav6va3ofp2dr11iuh5i6b1nn082mi/family1/a400b541fce14d9e9705ace6e046a52f 2023-11-30 20:53:34,863 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/808c917efa7746df8406133ced12bd0f_SeqId_44_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/808c917efa7746df8406133ced12bd0f_SeqId_44_ 2023-11-30 20:53:34,866 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mqtht5la4iesud6t4v5bkd9ojpc9bjealejav6va3ofp2dr11iuh5i6b1nn082mi/family1/a400b541fce14d9e9705ace6e046a52f as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3e42121b22d04759ae97b446be7b13aa_SeqId_47_ 2023-11-30 20:53:34,866 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mqtht5la4iesud6t4v5bkd9ojpc9bjealejav6va3ofp2dr11iuh5i6b1nn082mi/family1/a400b541fce14d9e9705ace6e046a52f into 459120585a3b68683a2916d188707129/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3e42121b22d04759ae97b446be7b13aa_SeqId_47_ - updating store file list. 2023-11-30 20:53:34,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3e42121b22d04759ae97b446be7b13aa_SeqId_47_ into 459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:34,882 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mqtht5la4iesud6t4v5bkd9ojpc9bjealejav6va3ofp2dr11iuh5i6b1nn082mi/family1/a400b541fce14d9e9705ace6e046a52f into 459120585a3b68683a2916d188707129/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3e42121b22d04759ae97b446be7b13aa_SeqId_47_) 2023-11-30 20:53:34,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__mqtht5la4iesud6t4v5bkd9ojpc9bjealejav6va3ofp2dr11iuh5i6b1nn082mi/family1/a400b541fce14d9e9705ace6e046a52f 2023-11-30 20:53:34,883 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-30 20:53:34,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 367249 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-30 20:53:34,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): 459120585a3b68683a2916d188707129/family1 is initiating minor compaction (all files) 2023-11-30 20:53:34,884 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4b90f6a3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:34,884 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 459120585a3b68683a2916d188707129/family1 in testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:34,885 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3153852aebf54579802cd2f6c7a8cf60, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/6fe8dc12538e4a3a8d2fa717f1fa2eb6, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3e42121b22d04759ae97b446be7b13aa_SeqId_47_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp, totalSize=358.6 K 2023-11-30 20:53:34,885 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 3153852aebf54579802cd2f6c7a8cf60, keycount=1000, bloomtype=ROW, size=175.8 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824433 2023-11-30 20:53:34,886 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 6fe8dc12538e4a3a8d2fa717f1fa2eb6, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224433 2023-11-30 20:53:34,886 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 3e42121b22d04759ae97b446be7b13aa_SeqId_47_, keycount=1002, bloomtype=ROW, size=176.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824433 2023-11-30 20:53:34,887 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:34,888 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:34,891 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130260eee16c9134c7cb05521b1bac57372 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151130260eee16c9134c7cb05521b1bac57372 2023-11-30 20:53:34,893 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201505438139ad64a6ba1db4391d9fe8b8c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e20151201505438139ad64a6ba1db4391d9fe8b8c 2023-11-30 20:53:34,894 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512055712d64095db406dbb171b70188603ec to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201512055712d64095db406dbb171b70188603ec 2023-11-30 20:53:34,895 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 3 expired mob files are deleted 2023-11-30 20:53:34,895 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-30 20:53:34,895 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:34,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:34,895 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:53:34,896 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=12, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-30 20:53:34,898 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=12, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 2.0490 sec 2023-11-30 20:53:34,927 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 459120585a3b68683a2916d188707129#family1#compaction#11 average throughput is 6.88 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:53:35,066 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthly from 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-30 20:53:35,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=13, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:35,491 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-30 20:53:35,492 DEBUG [PEWorker-1] util.FSTableDescriptors(519): Deleted hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000001 2023-11-30 20:53:35,492 INFO [PEWorker-1] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/.tabledesc/.tableinfo.0000000002 2023-11-30 20:53:35,497 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=14, ppid=13, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly}] 2023-11-30 20:53:35,510 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=459120585a3b68683a2916d188707129, REOPEN/MOVE}] 2023-11-30 20:53:35,511 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=459120585a3b68683a2916d188707129, REOPEN/MOVE 2023-11-30 20:53:35,512 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=459120585a3b68683a2916d188707129, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:35,513 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701377615512"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377615512"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377615512"}]},"ts":"1701377615512"} 2023-11-30 20:53:35,516 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=16, ppid=15, state=RUNNABLE; CloseRegionProcedure 459120585a3b68683a2916d188707129, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:53:35,673 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:35,675 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 459120585a3b68683a2916d188707129 2023-11-30 20:53:35,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 459120585a3b68683a2916d188707129, disabling compactions & flushes 2023-11-30 20:53:35,676 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:35,772 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/.tmp/family1/dd9e8e2825124289b2d8bc1f6ab04de4 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/dd9e8e2825124289b2d8bc1f6ab04de4 2023-11-30 20:53:35,780 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 459120585a3b68683a2916d188707129/family1 of 459120585a3b68683a2916d188707129 into dd9e8e2825124289b2d8bc1f6ab04de4(size=177.2 K), total size for store is 177.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:53:35,780 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:35,780 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:35,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:35,781 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129., storeName=family1, fileCount=3, fileSize=358.6 K (175.8 K, 6.6 K, 176.2 K), priority=2, time=1701377614884; duration=0sec 2023-11-30 20:53:35,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. after waiting 0 ms 2023-11-30 20:53:35,781 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:35,781 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:35,784 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3153852aebf54579802cd2f6c7a8cf60, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/6fe8dc12538e4a3a8d2fa717f1fa2eb6, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3e42121b22d04759ae97b446be7b13aa_SeqId_47_] to archive 2023-11-30 20:53:35,785 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:35,787 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3153852aebf54579802cd2f6c7a8cf60 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3153852aebf54579802cd2f6c7a8cf60 2023-11-30 20:53:35,789 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/6fe8dc12538e4a3a8d2fa717f1fa2eb6 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/6fe8dc12538e4a3a8d2fa717f1fa2eb6 2023-11-30 20:53:35,791 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3e42121b22d04759ae97b446be7b13aa_SeqId_47_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/3e42121b22d04759ae97b446be7b13aa_SeqId_47_ 2023-11-30 20:53:35,798 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-30 20:53:35,799 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:35,799 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:35,799 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: 459120585a3b68683a2916d188707129 to self. 2023-11-30 20:53:35,801 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 459120585a3b68683a2916d188707129 2023-11-30 20:53:35,802 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=459120585a3b68683a2916d188707129, regionState=CLOSED 2023-11-30 20:53:35,803 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701377615802"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377615802"}]},"ts":"1701377615802"} 2023-11-30 20:53:35,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=16, resume processing ppid=15 2023-11-30 20:53:35,807 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=16, ppid=15, state=SUCCESS; CloseRegionProcedure 459120585a3b68683a2916d188707129, server=jenkins-hbase4.apache.org,40365,1701377600631 in 289 msec 2023-11-30 20:53:35,808 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=15, ppid=14, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=459120585a3b68683a2916d188707129, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=true 2023-11-30 20:53:35,958 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=459120585a3b68683a2916d188707129, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:35,958 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701377615958"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377615958"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377615958"}]},"ts":"1701377615958"} 2023-11-30 20:53:35,961 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=17, ppid=15, state=RUNNABLE; OpenRegionProcedure 459120585a3b68683a2916d188707129, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:53:36,114 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:36,118 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:36,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 459120585a3b68683a2916d188707129, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:53:36,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthly 459120585a3b68683a2916d188707129 2023-11-30 20:53:36,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:36,118 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 459120585a3b68683a2916d188707129 2023-11-30 20:53:36,119 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 459120585a3b68683a2916d188707129 2023-11-30 20:53:36,120 INFO [StoreOpener-459120585a3b68683a2916d188707129-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 459120585a3b68683a2916d188707129 2023-11-30 20:53:36,121 DEBUG [StoreOpener-459120585a3b68683a2916d188707129-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:36,121 DEBUG [StoreOpener-459120585a3b68683a2916d188707129-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:36,122 INFO [StoreOpener-459120585a3b68683a2916d188707129-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 459120585a3b68683a2916d188707129 columnFamilyName family1 2023-11-30 20:53:36,130 DEBUG [StoreOpener-459120585a3b68683a2916d188707129-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/dd9e8e2825124289b2d8bc1f6ab04de4 2023-11-30 20:53:36,130 INFO [StoreOpener-459120585a3b68683a2916d188707129-1] regionserver.HStore(310): Store=459120585a3b68683a2916d188707129/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:36,131 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129 2023-11-30 20:53:36,133 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129 2023-11-30 20:53:36,136 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 459120585a3b68683a2916d188707129 2023-11-30 20:53:36,137 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 459120585a3b68683a2916d188707129; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=64332602, jitterRate=-0.04136952757835388}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:53:36,137 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:36,138 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129., pid=17, masterSystemTime=1701377616114 2023-11-30 20:53:36,140 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:36,140 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:53:36,141 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=15 updating hbase:meta row=459120585a3b68683a2916d188707129, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:36,141 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129.","families":{"info":[{"qualifier":"regioninfo","vlen":80,"tag":[],"timestamp":"1701377616141"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377616141"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377616141"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377616141"}]},"ts":"1701377616141"} 2023-11-30 20:53:36,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=17, resume processing ppid=15 2023-11-30 20:53:36,145 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=17, ppid=15, state=SUCCESS; OpenRegionProcedure 459120585a3b68683a2916d188707129, server=jenkins-hbase4.apache.org,40365,1701377600631 in 182 msec 2023-11-30 20:53:36,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=15, resume processing ppid=14 2023-11-30 20:53:36,147 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=15, ppid=14, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly, region=459120585a3b68683a2916d188707129, REOPEN/MOVE in 635 msec 2023-11-30 20:53:36,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=14, resume processing ppid=13 2023-11-30 20:53:36,151 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=14, ppid=13, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 653 msec 2023-11-30 20:53:36,154 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=13, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthly in 1.0840 sec 2023-11-30 20:53:36,157 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=13 2023-11-30 20:53:36,165 INFO [Listener at localhost/34291] compactions.TestMobCompactor(278): alter status finished 2023-11-30 20:53:36,166 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthly 2023-11-30 20:53:36,168 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-30 20:53:36,169 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=18, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-30 20:53:36,170 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:53:36,170 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=18, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378216170 2023-11-30 20:53:36,171 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:53:36,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthly' and column 'family1' 2023-11-30 20:53:36,172 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:36,174 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x42aa998d to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:53:36,180 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@35a67120, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:53:36,180 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:36,181 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:36,181 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:36,181 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:36,181 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:36,558 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:53:36,559 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x5072fb05 to 127.0.0.1:58095 2023-11-30 20:53:36,559 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:53:37,019 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511283642bfc04c4f4ec78145178cfe873942 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511283642bfc04c4f4ec78145178cfe873942 2023-11-30 20:53:37,020 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:37,036 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:53:37,037 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:44318, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:53:37,045 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:53:37,047 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35914, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:53:37,058 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d1305bc1845945309804f7c15e3e9233 first=Optional[r05] last=Optional[r8] 2023-11-30 20:53:37,058 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=51 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d1305bc1845945309804f7c15e3e9233}] 2023-11-30 20:53:37,063 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d1305bc1845945309804f7c15e3e9233 for inclusion in 459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:37,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-30 20:53:37,067 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:53:37,068 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:53:37,069 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/d1305bc1845945309804f7c15e3e9233 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sg3nm6mqqupjefk95qbvm1t9q6id2jip09pdp43o514sab8k2crqd30gc92gbidl/family1/d1305bc1845945309804f7c15e3e9233 2023-11-30 20:53:37,072 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sg3nm6mqqupjefk95qbvm1t9q6id2jip09pdp43o514sab8k2crqd30gc92gbidl/family1/d1305bc1845945309804f7c15e3e9233 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/1c4dbb37c29a44ba87d059c21c6ba0f6_SeqId_53_ 2023-11-30 20:53:37,073 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sg3nm6mqqupjefk95qbvm1t9q6id2jip09pdp43o514sab8k2crqd30gc92gbidl/family1/d1305bc1845945309804f7c15e3e9233 into 459120585a3b68683a2916d188707129/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/1c4dbb37c29a44ba87d059c21c6ba0f6_SeqId_53_ - updating store file list. 2023-11-30 20:53:37,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/1c4dbb37c29a44ba87d059c21c6ba0f6_SeqId_53_ into 459120585a3b68683a2916d188707129/family1 2023-11-30 20:53:37,079 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sg3nm6mqqupjefk95qbvm1t9q6id2jip09pdp43o514sab8k2crqd30gc92gbidl/family1/d1305bc1845945309804f7c15e3e9233 into 459120585a3b68683a2916d188707129/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/family1/1c4dbb37c29a44ba87d059c21c6ba0f6_SeqId_53_) 2023-11-30 20:53:37,080 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthly__sg3nm6mqqupjefk95qbvm1t9q6id2jip09pdp43o514sab8k2crqd30gc92gbidl/family1/d1305bc1845945309804f7c15e3e9233 2023-11-30 20:53:37,082 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:37,083 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:37,085 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202129f02665884ea3ab610591841ab1bc to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e201511202129f02665884ea3ab610591841ab1bc 2023-11-30 20:53:37,086 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112842c831bb8fd14b9da059b2535bd1eb52 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/5cf2233aabbe1315e9fba5c3199b4c19/family1/d41d8cd98f00b204e9800998ecf8427e2015112842c831bb8fd14b9da059b2535bd1eb52 2023-11-30 20:53:37,087 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthly 2 expired mob files are deleted 2023-11-30 20:53:37,087 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-30 20:53:37,087 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:37,087 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:37,087 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthly' and column='family1' 2023-11-30 20:53:37,087 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthly' column='family1' 2023-11-30 20:53:37,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:53:37,088 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=18, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE 2023-11-30 20:53:37,090 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=18, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthly.mobLock, type=EXCLUSIVE in 921 msec 2023-11-30 20:53:37,179 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthly Thread=248 (was 214) Potentially hanging thread: RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:38168 [Waiting for operation #13] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:38214 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hfile_cleaner-dir-scan-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RSProcedureDispatcher-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/cluster_1a0b3a74-9b82-6bde-be73-7dfdec67973f/dfs/data/data1/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:40082 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39944 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35d88b3b-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS-EventLoopGroup-1-3 org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native Method) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:209) org.apache.hbase.thirdparty.io.netty.channel.epoll.Native.epollWait(Native.java:202) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.epollWaitNoTimerChange(EpollEventLoop.java:316) org.apache.hbase.thirdparty.io.netty.channel.epoll.EpollEventLoop.run(EpollEventLoop.java:373) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Timer for 'HBase' metrics system java.lang.Object.wait(Native Method) java.util.TimerThread.mainLoop(Timer.java:552) java.util.TimerThread.run(Timer.java:505) Potentially hanging thread: hconnection-0x35d88b3b-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39886 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:40026 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58095@0x42aa998d sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1987356078.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:40090 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39918 [Waiting for operation #27] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58095@0x42aa998d-SendThread(127.0.0.1:58095) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-2 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58095@0x42aa998d-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: MobCompactor-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39998 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39914 [Waiting for operation #15] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-3 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RPCClient-NioEventLoopGroup-4-4 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hbase.thirdparty.io.netty.channel.nio.SelectedSelectionKeySetSelector.select(SelectedSelectionKeySetSelector.java:62) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.select(NioEventLoop.java:883) org.apache.hbase.thirdparty.io.netty.channel.nio.NioEventLoop.run(NioEventLoop.java:526) org.apache.hbase.thirdparty.io.netty.util.concurrent.SingleThreadEventExecutor$4.run(SingleThreadEventExecutor.java:997) org.apache.hbase.thirdparty.io.netty.util.internal.ThreadExecutorMap$2.run(ThreadExecutorMap.java:74) org.apache.hbase.thirdparty.io.netty.util.concurrent.FastThreadLocalRunnable.run(FastThreadLocalRunnable.java:30) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39956 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_188037256_17 at /127.0.0.1:40032 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:38194 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39876 [Waiting for operation #11] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: RS:0;jenkins-hbase4:40365-shortCompactions-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.PriorityBlockingQueue.take(PriorityBlockingQueue.java:549) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39902 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: (jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:458) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.take(SynchronousQueue.java:924) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1074) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:40014 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x35d88b3b-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: htable-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.SynchronousQueue$TransferStack.awaitFulfill(SynchronousQueue.java:460) java.util.concurrent.SynchronousQueue$TransferStack.transfer(SynchronousQueue.java:362) java.util.concurrent.SynchronousQueue.poll(SynchronousQueue.java:941) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: Async disk worker #0 for volume /home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/cluster_1a0b3a74-9b82-6bde-be73-7dfdec67973f/dfs/data/data2/current sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=614 (was 505) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=302 (was 341), ProcessCount=173 (was 173), AvailableMemoryMB=7656 (was 7732) 2023-11-30 20:53:37,195 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=248, OpenFileDescriptor=614, MaxFileDescriptor=60000, SystemLoadAverage=302, ProcessCount=173, AvailableMemoryMB=7655 2023-11-30 20:53:37,197 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-30 20:53:37,199 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:37,201 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:53:37,202 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithMonthlyPolicy" procId is: 19 2023-11-30 20:53:37,202 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:53:37,202 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-30 20:53:37,204 DEBUG [HFileArchiver-3] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230 2023-11-30 20:53:37,205 DEBUG [HFileArchiver-3] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230 empty. 2023-11-30 20:53:37,205 DEBUG [HFileArchiver-3] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230 2023-11-30 20:53:37,205 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithMonthlyPolicy regions 2023-11-30 20:53:37,304 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-30 20:53:37,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-30 20:53:37,616 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-30 20:53:37,618 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => ff44000446a9095d68151bec61f51230, NAME => 'testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:53:37,624 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:37,624 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing ff44000446a9095d68151bec61f51230, disabling compactions & flushes 2023-11-30 20:53:37,624 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:37,624 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:37,624 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. after waiting 0 ms 2023-11-30 20:53:37,625 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:37,625 INFO [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:37,625 DEBUG [RegionOpenAndInit-testMajorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:37,628 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:53:37,629 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701377617629"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377617629"}]},"ts":"1701377617629"} 2023-11-30 20:53:37,631 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-30 20:53:37,632 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:53:37,632 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377617632"}]},"ts":"1701377617632"} 2023-11-30 20:53:37,634 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-30 20:53:37,639 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=ff44000446a9095d68151bec61f51230, ASSIGN}] 2023-11-30 20:53:37,640 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=ff44000446a9095d68151bec61f51230, ASSIGN 2023-11-30 20:53:37,641 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=20, ppid=19, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=ff44000446a9095d68151bec61f51230, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:53:37,792 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ff44000446a9095d68151bec61f51230, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:37,792 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701377617792"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377617792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377617792"}]},"ts":"1701377617792"} 2023-11-30 20:53:37,795 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=21, ppid=20, state=RUNNABLE; OpenRegionProcedure ff44000446a9095d68151bec61f51230, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:53:37,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-30 20:53:37,947 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:37,951 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:37,951 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ff44000446a9095d68151bec61f51230, NAME => 'testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:53:37,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithMonthlyPolicy ff44000446a9095d68151bec61f51230 2023-11-30 20:53:37,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:37,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ff44000446a9095d68151bec61f51230 2023-11-30 20:53:37,952 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ff44000446a9095d68151bec61f51230 2023-11-30 20:53:37,953 INFO [StoreOpener-ff44000446a9095d68151bec61f51230-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ff44000446a9095d68151bec61f51230 2023-11-30 20:53:37,955 DEBUG [StoreOpener-ff44000446a9095d68151bec61f51230-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1 2023-11-30 20:53:37,955 DEBUG [StoreOpener-ff44000446a9095d68151bec61f51230-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1 2023-11-30 20:53:37,956 INFO [StoreOpener-ff44000446a9095d68151bec61f51230-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ff44000446a9095d68151bec61f51230 columnFamilyName family1 2023-11-30 20:53:37,957 INFO [StoreOpener-ff44000446a9095d68151bec61f51230-1] regionserver.HStore(310): Store=ff44000446a9095d68151bec61f51230/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:37,958 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230 2023-11-30 20:53:37,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230 2023-11-30 20:53:37,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ff44000446a9095d68151bec61f51230 2023-11-30 20:53:37,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:53:37,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ff44000446a9095d68151bec61f51230; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63589705, jitterRate=-0.052439555525779724}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:53:37,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:37,965 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230., pid=21, masterSystemTime=1701377617947 2023-11-30 20:53:37,967 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:37,967 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:37,968 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=20 updating hbase:meta row=ff44000446a9095d68151bec61f51230, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:37,968 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701377617968"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377617968"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377617968"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377617968"}]},"ts":"1701377617968"} 2023-11-30 20:53:37,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=21, resume processing ppid=20 2023-11-30 20:53:37,972 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=21, ppid=20, state=SUCCESS; OpenRegionProcedure ff44000446a9095d68151bec61f51230, server=jenkins-hbase4.apache.org,40365,1701377600631 in 176 msec 2023-11-30 20:53:37,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=20, resume processing ppid=19 2023-11-30 20:53:37,975 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=20, ppid=19, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithMonthlyPolicy, region=ff44000446a9095d68151bec61f51230, ASSIGN in 333 msec 2023-11-30 20:53:37,976 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:53:37,976 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377617976"}]},"ts":"1701377617976"} 2023-11-30 20:53:37,977 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-30 20:53:38,059 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=19, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:53:38,062 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=19, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithMonthlyPolicy in 861 msec 2023-11-30 20:53:38,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=19 2023-11-30 20:53:38,308 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithMonthlyPolicy, procId: 19 completed 2023-11-30 20:53:38,341 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:38,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,344 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:38,344 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:38,345 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:38,345 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:38,345 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,345 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:38,404 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:38,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:38,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:38,405 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:38,405 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:38,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,405 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:38,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,406 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,407 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:38,407 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:38,407 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:38,408 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:38,408 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:38,408 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:38,408 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-30 20:53:38,841 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130b39aa0d1ed984b71a4dc84bb41dbf0ba to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b39aa0d1ed984b71a4dc84bb41dbf0ba 2023-11-30 20:53:38,846 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/7fe7213bbbe449daa1f6df8fef62d453 2023-11-30 20:53:38,852 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/7fe7213bbbe449daa1f6df8fef62d453 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/7fe7213bbbe449daa1f6df8fef62d453 2023-11-30 20:53:38,858 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/7fe7213bbbe449daa1f6df8fef62d453, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-30 20:53:38,859 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 451ms, sequenceid=5, compaction requested=false 2023-11-30 20:53:38,859 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:38,860 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:38,860 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:38,860 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:38,860 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:38,860 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:38,860 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:38,860 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:38,904 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:38,904 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:38,904 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:38,905 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,905 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:38,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:38,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:38,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:38,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@742021af[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:38,907 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:38,907 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,927 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,927 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:38,927 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:38,927 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:38,927 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:38,927 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:38,996 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:38,996 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:38,996 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:38,997 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:38,998 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:38,999 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:39,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:39,002 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:39,002 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:39,002 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:39,002 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:39,002 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,002 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:39,050 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,050 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,050 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:39,050 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:39,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,051 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:39,051 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,052 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,053 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,053 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:39,054 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,136 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,136 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:39,136 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:39,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:39,137 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:39,137 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:39,137 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:39,138 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:39,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:53:39,137 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,138 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,138 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,138 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,138 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,138 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:39,138 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:39,138 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:39,138 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:39,239 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:39,240 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:39,245 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:39,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:39,247 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,247 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:39,248 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:39,248 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:39,248 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:39,249 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,249 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,319 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,319 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:39,320 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:39,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:39,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:39,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:39,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,321 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:39,321 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,321 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,321 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:53:39,321 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:39,322 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:39,322 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:39,322 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:39,322 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:39,322 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:39,322 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:39,322 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:39,323 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-30 20:53:39,739 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128ecaeba47aca14ed59517bfa23e230bc5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ecaeba47aca14ed59517bfa23e230bc5 2023-11-30 20:53:40,146 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/90fcfa3400864fdba132c1408a6318df 2023-11-30 20:53:40,154 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/90fcfa3400864fdba132c1408a6318df as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/90fcfa3400864fdba132c1408a6318df 2023-11-30 20:53:40,160 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/90fcfa3400864fdba132c1408a6318df, entries=1, sequenceid=9, filesize=5.0 K 2023-11-30 20:53:40,161 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 838ms, sequenceid=9, compaction requested=false 2023-11-30 20:53:40,161 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:40,161 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:40,161 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:40,161 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:40,161 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,161 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:40,161 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:40,227 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,227 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:40,227 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:40,227 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:40,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:40,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@36a156c6[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:40,229 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:40,230 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,288 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,289 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,289 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:40,289 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:40,289 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,289 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:40,289 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:40,327 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,327 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:40,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:40,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:40,327 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:40,327 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:40,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:40,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:40,331 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:40,331 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:40,331 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:40,331 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:40,331 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,331 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:40,412 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,412 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,412 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:40,412 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,412 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:40,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:40,413 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:40,413 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:40,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,413 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,414 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,415 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,415 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,481 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,481 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:40,481 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,481 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:40,481 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:53:40,481 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:40,482 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:40,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:40,481 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:40,481 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:40,482 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,482 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,482 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:40,482 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,483 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:40,483 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,483 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:40,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:40,583 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:40,584 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:40,591 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:40,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:40,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,593 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:40,593 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:40,594 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:40,594 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:40,594 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,594 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,642 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,642 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:40,642 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:40,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:40,643 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,643 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:40,643 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,643 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:40,644 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,644 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,644 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:53:40,644 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,644 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:40,644 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:40,645 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:40,645 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:40,645 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:40,645 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:40,645 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:40,646 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:40,661 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512014c0ca948483e446b8fdc9f9b673dcd65 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014c0ca948483e446b8fdc9f9b673dcd65 2023-11-30 20:53:40,669 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/16565ac504284e909a775bfdb550a76b 2023-11-30 20:53:40,675 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/16565ac504284e909a775bfdb550a76b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/16565ac504284e909a775bfdb550a76b 2023-11-30 20:53:40,680 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/16565ac504284e909a775bfdb550a76b, entries=1, sequenceid=13, filesize=4.9 K 2023-11-30 20:53:40,681 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 35ms, sequenceid=13, compaction requested=true 2023-11-30 20:53:40,681 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:40,681 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:40,681 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:40,681 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:40,681 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,682 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:40,682 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:40,758 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,758 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:40,758 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,758 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:40,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:40,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:40,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:40,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:40,760 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@19266e7a[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:40,760 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:40,760 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,874 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,875 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,875 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:40,875 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:40,875 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:40,875 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,875 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:40,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:40,981 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:40,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:40,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:40,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:40,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:40,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:40,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:40,985 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:40,985 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:40,985 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:40,986 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:40,986 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:41,182 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,182 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,182 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,182 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:41,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:41,183 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:41,183 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:41,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:41,185 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:41,185 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:41,273 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:41,273 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,273 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:41,273 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,273 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:41,273 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:41,273 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:41,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:41,274 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:41,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:41,274 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:41,274 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:41,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:41,275 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:41,275 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:41,343 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:53:41,375 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:41,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:41,381 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:41,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:41,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,383 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:41,383 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:41,384 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:41,384 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:41,385 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,385 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,442 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:41,442 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:41,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:41,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:41,443 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:41,443 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,443 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:41,443 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:41,444 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,444 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,444 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:53:41,444 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:41,444 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:41,445 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:41,445 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:41,445 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:41,445 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:41,445 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:41,445 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:41,871 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053781b23c9c094483958731c447ab5207 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053781b23c9c094483958731c447ab5207 2023-11-30 20:53:42,278 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/fc7427500aed4589b977735ddc256f1a 2023-11-30 20:53:42,285 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/fc7427500aed4589b977735ddc256f1a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/fc7427500aed4589b977735ddc256f1a 2023-11-30 20:53:42,291 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/fc7427500aed4589b977735ddc256f1a, entries=1, sequenceid=17, filesize=4.9 K 2023-11-30 20:53:42,293 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 848ms, sequenceid=17, compaction requested=true 2023-11-30 20:53:42,293 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:42,293 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:42,293 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:42,293 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:42,293 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,293 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:42,293 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:42,334 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,334 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:42,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:42,335 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,335 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:42,335 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,337 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:42,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:42,337 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bce8853[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:42,337 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:42,337 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,374 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,374 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,374 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,374 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:42,374 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:42,374 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:42,374 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,374 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:42,550 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:42,550 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,550 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:42,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:42,550 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:42,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:42,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:42,555 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:42,555 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:42,555 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:42,555 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:42,555 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,555 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:42,618 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,618 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:42,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,618 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:42,619 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:42,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:42,619 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:42,620 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,621 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,621 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:42,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,622 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,704 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,704 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:42,704 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,704 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:42,704 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:42,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:42,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:42,704 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:42,704 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:53:42,704 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:42,704 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,705 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,705 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,705 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,705 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,706 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:42,706 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:42,706 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:42,806 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:42,807 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:42,813 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:42,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:42,815 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,815 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:42,815 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:42,816 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:42,816 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:42,816 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,816 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,818 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,818 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:42,818 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:42,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:42,819 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:42,819 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:42,819 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,819 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:42,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,820 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,820 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:53:42,820 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:42,820 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:42,821 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:42,822 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:42,822 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:42,822 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:42,822 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:42,822 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:43,240 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228f3bc696298b14d679782a43e016a570c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f3bc696298b14d679782a43e016a570c 2023-11-30 20:53:43,246 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/d767960ae9ae4352b81a832624e67c8e 2023-11-30 20:53:43,253 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/d767960ae9ae4352b81a832624e67c8e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/d767960ae9ae4352b81a832624e67c8e 2023-11-30 20:53:43,258 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/d767960ae9ae4352b81a832624e67c8e, entries=1, sequenceid=21, filesize=4.9 K 2023-11-30 20:53:43,259 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 437ms, sequenceid=21, compaction requested=true 2023-11-30 20:53:43,259 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:43,260 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:43,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:43,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:43,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:43,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:43,262 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,262 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:43,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,263 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:43,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:43,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:43,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:43,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:43,264 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4e96fbdc[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:43,264 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:43,264 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,266 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,266 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:43,266 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:43,266 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:43,266 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,266 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:43,268 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:43,268 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,268 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:43,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:43,268 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:43,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:43,272 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:43,272 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:43,272 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:43,272 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:43,272 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,272 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:43,274 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:43,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:43,274 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,274 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:43,274 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:43,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:43,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:43,276 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:43,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,278 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:43,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,281 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:43,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:43,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:43,281 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:43,281 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:43,281 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:43,282 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:43,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:43,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:43,282 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:43,282 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:43,284 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,284 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,284 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,284 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,284 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,284 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,284 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,383 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:43,384 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:43,389 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:43,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:43,390 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,390 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:43,391 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:43,391 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:43,391 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:43,392 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,392 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,394 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:43,394 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,394 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:43,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:43,394 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,394 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:43,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,395 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:43,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,395 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,396 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:53:43,396 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,396 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:43,396 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:43,396 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:43,400 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:43,400 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:43,400 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:43,400 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:43,400 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:43,826 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231cee391d002ea44da936db6b7abd109ce to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231cee391d002ea44da936db6b7abd109ce 2023-11-30 20:53:43,832 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/aba78267db56445594d52d5c3c2076a5 2023-11-30 20:53:43,839 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/aba78267db56445594d52d5c3c2076a5 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/aba78267db56445594d52d5c3c2076a5 2023-11-30 20:53:43,846 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/aba78267db56445594d52d5c3c2076a5, entries=1, sequenceid=25, filesize=4.9 K 2023-11-30 20:53:43,847 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 447ms, sequenceid=25, compaction requested=true 2023-11-30 20:53:43,847 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:43,847 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:43,847 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:43,847 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:43,847 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,847 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:43,847 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:43,851 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,851 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:43,851 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,851 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:43,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:43,852 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,853 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:43,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:43,853 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@723d83ae[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:43,853 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:43,854 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,855 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,855 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,855 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,855 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:43,855 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:43,855 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:43,855 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,856 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:43,857 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:43,857 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:43,858 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:43,861 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:43,861 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:43,861 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:43,861 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:43,861 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,861 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:43,863 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,863 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:43,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,863 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:43,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:43,864 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:43,864 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,864 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:43,865 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,865 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:43,866 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,869 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,869 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,869 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,869 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,869 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:43,869 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,870 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:53:43,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:43,870 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:43,870 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,870 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:43,870 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:43,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:43,871 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:43,871 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:43,871 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:43,871 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:43,871 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:43,971 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:43,972 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:43,978 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:43,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:43,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,979 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:43,979 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:43,980 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:43,980 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:43,980 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,981 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,982 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,982 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:43,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:43,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:43,982 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:43,982 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,983 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:43,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,984 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,984 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:53:43,984 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:43,984 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:43,985 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:43,985 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:43,985 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:43,985 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:43,985 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:43,985 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:44,001 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601012204d971969543c28d58bb1254a009e0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601012204d971969543c28d58bb1254a009e0 2023-11-30 20:53:44,007 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/3a834225efa44c5db1f31dc96738f946 2023-11-30 20:53:44,013 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/3a834225efa44c5db1f31dc96738f946 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/3a834225efa44c5db1f31dc96738f946 2023-11-30 20:53:44,019 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/3a834225efa44c5db1f31dc96738f946, entries=1, sequenceid=29, filesize=4.9 K 2023-11-30 20:53:44,020 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 35ms, sequenceid=29, compaction requested=true 2023-11-30 20:53:44,020 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:44,021 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:44,021 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:44,021 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:44,021 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,021 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:44,021 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:44,025 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,025 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:44,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:44,026 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,026 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:44,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:44,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:44,026 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,027 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:44,027 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:44,028 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58c2762d[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:44,028 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:44,028 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,030 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,030 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,030 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,030 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:44,030 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:44,030 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:44,030 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,030 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:44,032 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:44,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,032 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:44,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:44,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,036 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:44,036 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:44,036 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:44,036 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:44,036 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:44,036 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,036 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:44,038 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,038 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:44,038 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,038 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:44,039 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:44,039 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,040 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:44,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,043 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,043 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,043 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:44,043 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,044 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:44,044 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,044 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:44,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:44,044 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:44,044 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:44,044 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:44,045 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,045 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:44,045 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:44,045 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,045 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:44,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:44,145 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:44,146 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:44,153 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:44,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:44,155 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,155 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:44,155 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:44,156 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:44,156 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:44,156 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,156 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,159 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,159 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:44,159 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:44,159 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:44,159 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,160 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,160 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:44,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,161 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,161 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:53:44,162 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,162 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:44,162 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:44,163 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:44,163 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:44,163 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:44,163 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:44,163 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:44,163 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:44,579 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601030fc664f28f984a318b74239815205933 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030fc664f28f984a318b74239815205933 2023-11-30 20:53:44,586 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/f26d8ee80b4a4302baac66f2ee2d2e99 2023-11-30 20:53:44,591 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/f26d8ee80b4a4302baac66f2ee2d2e99 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/f26d8ee80b4a4302baac66f2ee2d2e99 2023-11-30 20:53:44,596 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/f26d8ee80b4a4302baac66f2ee2d2e99, entries=1, sequenceid=33, filesize=4.9 K 2023-11-30 20:53:44,597 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 434ms, sequenceid=33, compaction requested=true 2023-11-30 20:53:44,598 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:44,598 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:44,598 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:44,600 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,600 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:44,600 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,600 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:44,600 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,601 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,602 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:44,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:44,602 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1701e176[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:44,602 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:44,602 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,604 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,604 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:44,604 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:44,604 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:44,604 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,604 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:44,605 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:44,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:44,605 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:44,606 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:44,607 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,608 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:44,608 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:44,608 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:44,608 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:44,608 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:44,608 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,608 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:44,611 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,611 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,611 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:44,611 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:44,611 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:44,612 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:44,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:44,612 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,612 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,613 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,614 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:44,614 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,615 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,616 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,616 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:44,616 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:44,617 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,617 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:44,617 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:44,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:44,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:44,617 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:44,617 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,617 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,618 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,618 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:44,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:44,618 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:44,618 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:44,718 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:44,719 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:44,725 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:44,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:44,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,727 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:44,727 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:44,727 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:44,727 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:44,728 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,728 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,729 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,729 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:44,729 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:44,729 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:44,730 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,730 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,730 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:44,730 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,731 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,731 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:53:44,731 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,731 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:44,731 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:44,731 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:44,731 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:44,732 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:44,732 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:44,732 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:44,732 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:44,748 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907c62e92316dbd4b828428ecfad0fc7e1d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20150907c62e92316dbd4b828428ecfad0fc7e1d 2023-11-30 20:53:44,757 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/048c9978c2c04e9ab1460f6664e38559 2023-11-30 20:53:44,764 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/048c9978c2c04e9ab1460f6664e38559 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/048c9978c2c04e9ab1460f6664e38559 2023-11-30 20:53:44,770 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/048c9978c2c04e9ab1460f6664e38559, entries=1, sequenceid=37, filesize=4.9 K 2023-11-30 20:53:44,771 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 39ms, sequenceid=37, compaction requested=true 2023-11-30 20:53:44,771 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:44,771 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:44,771 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:44,771 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:44,771 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,771 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:44,772 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:44,773 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,773 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:44,774 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,774 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:44,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:44,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:44,775 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:44,776 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6eb0b051[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:44,776 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:44,776 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,778 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,778 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,778 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,778 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:44,778 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:44,778 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:44,778 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,778 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:44,780 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:44,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:44,780 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:44,780 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:44,781 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:44,782 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,783 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:44,783 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:44,783 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:44,783 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:44,783 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:44,783 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,783 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:44,786 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,786 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:44,786 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,786 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:44,786 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:44,787 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:44,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:44,787 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:44,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,787 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:44,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,788 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,788 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:44,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,789 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,794 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,795 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,795 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,795 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,795 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:44,795 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:44,795 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:44,795 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,795 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:44,795 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:44,795 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:44,795 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:44,796 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:44,795 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,795 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:53:44,796 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:44,797 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:44,797 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:44,897 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:44,898 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:44,903 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:44,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:44,904 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,904 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:44,904 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:44,905 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:53:44,905 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:44,905 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,905 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,907 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,907 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:44,907 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:44,907 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:44,907 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:44,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,908 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:44,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,908 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,908 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:53:44,909 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:53:44,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:53:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:44,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:44,910 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:44,910 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. started... 2023-11-30 20:53:44,910 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing ff44000446a9095d68151bec61f51230 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:44,927 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112089c6d099c0d8468a9ac6107674d962ae to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112089c6d099c0d8468a9ac6107674d962ae 2023-11-30 20:53:45,334 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/1de72dccdf3448458583e8bdb583c23a 2023-11-30 20:53:45,341 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/1de72dccdf3448458583e8bdb583c23a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/1de72dccdf3448458583e8bdb583c23a 2023-11-30 20:53:45,347 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/1de72dccdf3448458583e8bdb583c23a, entries=1, sequenceid=41, filesize=4.9 K 2023-11-30 20:53:45,348 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for ff44000446a9095d68151bec61f51230 in 438ms, sequenceid=41, compaction requested=true 2023-11-30 20:53:45,348 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:45,348 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:53:45,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:53:45,350 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,350 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:45,351 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,351 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:45,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:45,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:53:45,353 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@708e7eda[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:45,353 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:45,353 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,354 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,354 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,354 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:45,355 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:53:45,355 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:45,355 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,355 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:45,357 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,357 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:53:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:45,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:45,357 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:45,357 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:53:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:45,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:45,360 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:45,360 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:53:45,360 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:45,360 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:45,360 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,360 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:45,362 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,362 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,362 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,362 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:45,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:45,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:45,363 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:45,363 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:45,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:45,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,363 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:45,364 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,365 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:45,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,366 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,367 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:45,367 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:45,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithMonthlyPolicy' 2023-11-30 20:53:45,368 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:45,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:45,368 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:45,368 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,368 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:45,368 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:53:45,368 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,368 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:45,368 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:45,368 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:45,368 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:45,368 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:45,369 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,369 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,369 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,469 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:45,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:45,472 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithMonthlyPolicy 2023-11-30 20:53:45,473 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:53:45,474 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=22, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:53:45,475 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:53:45,475 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=22, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378225475 2023-11-30 20:53:45,476 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:53:45,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-30 20:53:45,478 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:53:45,479 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x66798574 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:53:45,483 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@60d0c7ea, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:53:45,483 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:53:45,919 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103434d6b5b836d4891a3615aa94b2cce89 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20160103434d6b5b836d4891a3615aa94b2cce89 2023-11-30 20:53:45,920 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:53:45,940 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:53:45,941 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:58888, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:53:45,949 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:53:45,950 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:48322, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:53:45,961 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/103163a4411a4fdaa6bded86b67e322b first=Optional[r5] last=Optional[r6] 2023-11-30 20:53:45,962 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/103163a4411a4fdaa6bded86b67e322b}] 2023-11-30 20:53:45,966 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/103163a4411a4fdaa6bded86b67e322b for inclusion in ff44000446a9095d68151bec61f51230/family1 2023-11-30 20:53:45,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-30 20:53:45,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:53:45,969 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:45,970 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/103163a4411a4fdaa6bded86b67e322b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3jgg14j5bn76oiq6j9q6rgjdr4uq2t09eh8dqcdmmrdkbnecl5ob1abkrek8n0p6/family1/103163a4411a4fdaa6bded86b67e322b 2023-11-30 20:53:45,973 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3jgg14j5bn76oiq6j9q6rgjdr4uq2t09eh8dqcdmmrdkbnecl5ob1abkrek8n0p6/family1/103163a4411a4fdaa6bded86b67e322b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/c0f24fc3d295446b9826ad452500aaa0_SeqId_44_ 2023-11-30 20:53:45,974 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3jgg14j5bn76oiq6j9q6rgjdr4uq2t09eh8dqcdmmrdkbnecl5ob1abkrek8n0p6/family1/103163a4411a4fdaa6bded86b67e322b into ff44000446a9095d68151bec61f51230/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/c0f24fc3d295446b9826ad452500aaa0_SeqId_44_ - updating store file list. 2023-11-30 20:53:45,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/c0f24fc3d295446b9826ad452500aaa0_SeqId_44_ into ff44000446a9095d68151bec61f51230/family1 2023-11-30 20:53:45,980 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3jgg14j5bn76oiq6j9q6rgjdr4uq2t09eh8dqcdmmrdkbnecl5ob1abkrek8n0p6/family1/103163a4411a4fdaa6bded86b67e322b into ff44000446a9095d68151bec61f51230/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/c0f24fc3d295446b9826ad452500aaa0_SeqId_44_) 2023-11-30 20:53:45,980 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__3jgg14j5bn76oiq6j9q6rgjdr4uq2t09eh8dqcdmmrdkbnecl5ob1abkrek8n0p6/family1/103163a4411a4fdaa6bded86b67e322b 2023-11-30 20:53:45,981 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-30 20:53:45,985 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-30 20:53:45,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): ff44000446a9095d68151bec61f51230/family1 is initiating minor compaction 2023-11-30 20:53:45,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@3ffcdc17; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:45,986 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ff44000446a9095d68151bec61f51230/family1 in testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:45,986 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/90fcfa3400864fdba132c1408a6318df, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/16565ac504284e909a775bfdb550a76b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/fc7427500aed4589b977735ddc256f1a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/d767960ae9ae4352b81a832624e67c8e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/aba78267db56445594d52d5c3c2076a5, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/3a834225efa44c5db1f31dc96738f946, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/f26d8ee80b4a4302baac66f2ee2d2e99, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/048c9978c2c04e9ab1460f6664e38559, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/1de72dccdf3448458583e8bdb583c23a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/c0f24fc3d295446b9826ad452500aaa0_SeqId_44_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp, totalSize=49.7 K 2023-11-30 20:53:45,986 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 90fcfa3400864fdba132c1408a6318df, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-30 20:53:45,986 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 16565ac504284e909a775bfdb550a76b, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-30 20:53:45,986 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting fc7427500aed4589b977735ddc256f1a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-30 20:53:45,987 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting d767960ae9ae4352b81a832624e67c8e, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-30 20:53:45,987 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting aba78267db56445594d52d5c3c2076a5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-30 20:53:45,987 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 3a834225efa44c5db1f31dc96738f946, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-30 20:53:45,987 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting f26d8ee80b4a4302baac66f2ee2d2e99, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-30 20:53:45,987 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 048c9978c2c04e9ab1460f6664e38559, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-30 20:53:45,987 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 1de72dccdf3448458583e8bdb583c23a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-30 20:53:45,987 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting c0f24fc3d295446b9826ad452500aaa0_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-30 20:53:45,988 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:53:45,990 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:45,992 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601012204d971969543c28d58bb1254a009e0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601012204d971969543c28d58bb1254a009e0 2023-11-30 20:53:45,993 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030fc664f28f984a318b74239815205933 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201601030fc664f28f984a318b74239815205933 2023-11-30 20:53:45,993 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-30 20:53:45,993 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-30 20:53:45,994 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:53:45,994 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:53:46,040 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): ff44000446a9095d68151bec61f51230#family1#compaction#22 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:53:46,461 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/31b466e12c85487a982c3620b37dbf10 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/31b466e12c85487a982c3620b37dbf10 2023-11-30 20:53:46,464 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231487cc43743cc49a4974a6e76143aef74 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231487cc43743cc49a4974a6e76143aef74 2023-11-30 20:53:46,466 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:53:46,468 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in ff44000446a9095d68151bec61f51230/family1 of ff44000446a9095d68151bec61f51230 into 31b466e12c85487a982c3620b37dbf10(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:53:46,468 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:46,468 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1701377625986; duration=0sec 2023-11-30 20:53:46,468 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:46,491 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/32f2b12e813642139dd15dbf0bd69b37 first=Optional[r1] last=Optional[r4] 2023-11-30 20:53:46,491 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/32f2b12e813642139dd15dbf0bd69b37}] 2023-11-30 20:53:46,494 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/32f2b12e813642139dd15dbf0bd69b37 for inclusion in ff44000446a9095d68151bec61f51230/family1 2023-11-30 20:53:46,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-30 20:53:46,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:53:46,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:46,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/32f2b12e813642139dd15dbf0bd69b37 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__paiuqvkv99ia7ua6rk89hj5t621biikqk70lkt3pu7fd9b27mnblsi5fln0mp1an/family1/32f2b12e813642139dd15dbf0bd69b37 2023-11-30 20:53:46,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__paiuqvkv99ia7ua6rk89hj5t621biikqk70lkt3pu7fd9b27mnblsi5fln0mp1an/family1/32f2b12e813642139dd15dbf0bd69b37 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/8ba4357fa9ac439bb5efec4bfb7b13a1_SeqId_47_ 2023-11-30 20:53:46,501 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__paiuqvkv99ia7ua6rk89hj5t621biikqk70lkt3pu7fd9b27mnblsi5fln0mp1an/family1/32f2b12e813642139dd15dbf0bd69b37 into ff44000446a9095d68151bec61f51230/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/8ba4357fa9ac439bb5efec4bfb7b13a1_SeqId_47_ - updating store file list. 2023-11-30 20:53:46,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/8ba4357fa9ac439bb5efec4bfb7b13a1_SeqId_47_ into ff44000446a9095d68151bec61f51230/family1 2023-11-30 20:53:46,506 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__paiuqvkv99ia7ua6rk89hj5t621biikqk70lkt3pu7fd9b27mnblsi5fln0mp1an/family1/32f2b12e813642139dd15dbf0bd69b37 into ff44000446a9095d68151bec61f51230/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/8ba4357fa9ac439bb5efec4bfb7b13a1_SeqId_47_) 2023-11-30 20:53:46,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__paiuqvkv99ia7ua6rk89hj5t621biikqk70lkt3pu7fd9b27mnblsi5fln0mp1an/family1/32f2b12e813642139dd15dbf0bd69b37 2023-11-30 20:53:46,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-30 20:53:46,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-30 20:53:46,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): ff44000446a9095d68151bec61f51230/family1 is initiating minor compaction (all files) 2023-11-30 20:53:46,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@2f1613ce; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:46,508 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of ff44000446a9095d68151bec61f51230/family1 in testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:53:46,509 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/7fe7213bbbe449daa1f6df8fef62d453, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/31b466e12c85487a982c3620b37dbf10, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/8ba4357fa9ac439bb5efec4bfb7b13a1_SeqId_47_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp, totalSize=178.1 K 2023-11-30 20:53:46,509 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 7fe7213bbbe449daa1f6df8fef62d453, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824433 2023-11-30 20:53:46,510 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 31b466e12c85487a982c3620b37dbf10, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224433 2023-11-30 20:53:46,510 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 8ba4357fa9ac439bb5efec4bfb7b13a1_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224433 2023-11-30 20:53:46,511 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:53:46,511 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:46,514 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014c0ca948483e446b8fdc9f9b673dcd65 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512014c0ca948483e446b8fdc9f9b673dcd65 2023-11-30 20:53:46,515 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053781b23c9c094483958731c447ab5207 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201512053781b23c9c094483958731c447ab5207 2023-11-30 20:53:46,520 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f3bc696298b14d679782a43e016a570c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151228f3bc696298b14d679782a43e016a570c 2023-11-30 20:53:46,529 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231cee391d002ea44da936db6b7abd109ce to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151231cee391d002ea44da936db6b7abd109ce 2023-11-30 20:53:46,529 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-30 20:53:46,529 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-30 20:53:46,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/90fcfa3400864fdba132c1408a6318df, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/16565ac504284e909a775bfdb550a76b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/fc7427500aed4589b977735ddc256f1a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/d767960ae9ae4352b81a832624e67c8e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/aba78267db56445594d52d5c3c2076a5, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/3a834225efa44c5db1f31dc96738f946, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/f26d8ee80b4a4302baac66f2ee2d2e99, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/048c9978c2c04e9ab1460f6664e38559, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/1de72dccdf3448458583e8bdb583c23a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/c0f24fc3d295446b9826ad452500aaa0_SeqId_44_] to archive 2023-11-30 20:53:46,529 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:53:46,530 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:53:46,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:46,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/90fcfa3400864fdba132c1408a6318df to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/90fcfa3400864fdba132c1408a6318df 2023-11-30 20:53:46,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/16565ac504284e909a775bfdb550a76b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/16565ac504284e909a775bfdb550a76b 2023-11-30 20:53:46,538 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/fc7427500aed4589b977735ddc256f1a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/fc7427500aed4589b977735ddc256f1a 2023-11-30 20:53:46,540 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/d767960ae9ae4352b81a832624e67c8e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/d767960ae9ae4352b81a832624e67c8e 2023-11-30 20:53:46,542 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/aba78267db56445594d52d5c3c2076a5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/aba78267db56445594d52d5c3c2076a5 2023-11-30 20:53:46,544 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/3a834225efa44c5db1f31dc96738f946 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/3a834225efa44c5db1f31dc96738f946 2023-11-30 20:53:46,547 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/f26d8ee80b4a4302baac66f2ee2d2e99 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/f26d8ee80b4a4302baac66f2ee2d2e99 2023-11-30 20:53:46,548 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/048c9978c2c04e9ab1460f6664e38559 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/048c9978c2c04e9ab1460f6664e38559 2023-11-30 20:53:46,548 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): ff44000446a9095d68151bec61f51230#family1#compaction#23 average throughput is 10.37 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:53:46,551 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/1de72dccdf3448458583e8bdb583c23a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/1de72dccdf3448458583e8bdb583c23a 2023-11-30 20:53:46,553 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/c0f24fc3d295446b9826ad452500aaa0_SeqId_44_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/c0f24fc3d295446b9826ad452500aaa0_SeqId_44_ 2023-11-30 20:53:46,999 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511302450bcf45fc74dcd81aa6b540e51bf38 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e201511302450bcf45fc74dcd81aa6b540e51bf38 2023-11-30 20:53:47,000 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:53:47,026 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/65499b5b26f249c9b20baf2c5edebbc3 first=Optional[r00] last=Optional[r8] 2023-11-30 20:53:47,027 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/65499b5b26f249c9b20baf2c5edebbc3}] 2023-11-30 20:53:47,029 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/65499b5b26f249c9b20baf2c5edebbc3 for inclusion in ff44000446a9095d68151bec61f51230/family1 2023-11-30 20:53:47,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-30 20:53:47,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:53:47,033 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:47,034 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/65499b5b26f249c9b20baf2c5edebbc3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2a0p7diseal6f974m3qsmfijhc1fs2ejcub05g055vc80ou12g6prioahhns4bdi/family1/65499b5b26f249c9b20baf2c5edebbc3 2023-11-30 20:53:47,036 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2a0p7diseal6f974m3qsmfijhc1fs2ejcub05g055vc80ou12g6prioahhns4bdi/family1/65499b5b26f249c9b20baf2c5edebbc3 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/6ea6fb8725e2460ea4a36a2d53a8f606_SeqId_49_ 2023-11-30 20:53:47,037 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2a0p7diseal6f974m3qsmfijhc1fs2ejcub05g055vc80ou12g6prioahhns4bdi/family1/65499b5b26f249c9b20baf2c5edebbc3 into ff44000446a9095d68151bec61f51230/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/6ea6fb8725e2460ea4a36a2d53a8f606_SeqId_49_ - updating store file list. 2023-11-30 20:53:47,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/6ea6fb8725e2460ea4a36a2d53a8f606_SeqId_49_ into ff44000446a9095d68151bec61f51230/family1 2023-11-30 20:53:47,042 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2a0p7diseal6f974m3qsmfijhc1fs2ejcub05g055vc80ou12g6prioahhns4bdi/family1/65499b5b26f249c9b20baf2c5edebbc3 into ff44000446a9095d68151bec61f51230/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/6ea6fb8725e2460ea4a36a2d53a8f606_SeqId_49_) 2023-11-30 20:53:47,042 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithMonthlyPolicy__2a0p7diseal6f974m3qsmfijhc1fs2ejcub05g055vc80ou12g6prioahhns4bdi/family1/65499b5b26f249c9b20baf2c5edebbc3 2023-11-30 20:53:47,044 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:53:47,045 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:47,047 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112089c6d099c0d8468a9ac6107674d962ae to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e2015112089c6d099c0d8468a9ac6107674d962ae 2023-11-30 20:53:47,048 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ecaeba47aca14ed59517bfa23e230bc5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151128ecaeba47aca14ed59517bfa23e230bc5 2023-11-30 20:53:47,050 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b39aa0d1ed984b71a4dc84bb41dbf0ba to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/f69248d06ee0aebcc88185d282c3e762/family1/d41d8cd98f00b204e9800998ecf8427e20151130b39aa0d1ed984b71a4dc84bb41dbf0ba 2023-11-30 20:53:47,050 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-30 20:53:47,050 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-30 20:53:47,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:53:47,050 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:53:47,051 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:53:47,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:53:47,051 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithMonthlyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:53:47,051 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=22, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:53:47,053 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=22, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.5790 sec 2023-11-30 20:53:47,160 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithMonthlyPolicy Thread=266 (was 248) Potentially hanging thread: hconnection-0xe181145-shared-pool-23 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11201998-shared-pool-5 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58095@0x66798574-SendThread(127.0.0.1:58095) sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.zookeeper.ClientCnxnSocketNIO.doTransport(ClientCnxnSocketNIO.java:332) org.apache.zookeeper.ClientCnxn$SendThread.run(ClientCnxn.java:1289) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58095@0x66798574 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.DelayQueue.poll(DelayQueue.java:259) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient.run(ReadOnlyZKClient.java:324) org.apache.hadoop.hbase.zookeeper.ReadOnlyZKClient$$Lambda$88/1987356078.run(Unknown Source) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:38168 [Waiting for operation #25] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_188037256_17 at /127.0.0.1:34064 [Receiving block BP-1678533640-172.31.14.131-1701377595919:blk_1073741898_1074] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read1(BufferedInputStream.java:286) java.io.BufferedInputStream.read(BufferedInputStream.java:345) java.io.DataInputStream.read(DataInputStream.java:149) org.apache.hadoop.io.IOUtils.readFully(IOUtils.java:209) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doReadFully(PacketReceiver.java:211) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.doRead(PacketReceiver.java:134) org.apache.hadoop.hdfs.protocol.datatransfer.PacketReceiver.receiveNextPacket(PacketReceiver.java:109) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receivePacket(BlockReceiver.java:528) org.apache.hadoop.hdfs.server.datanode.BlockReceiver.receiveBlock(BlockReceiver.java:968) org.apache.hadoop.hdfs.server.datanode.DataXceiver.writeBlock(DataXceiver.java:877) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.opWriteBlock(Receiver.java:166) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.processOp(Receiver.java:103) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:290) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33934 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33984 [Waiting for operation #7] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe181145-shared-pool-22 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_188037256_17 at /127.0.0.1:33916 [Waiting for operation #18] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0xe181145-shared-pool-21 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: PacketResponder: BP-1678533640-172.31.14.131-1701377595919:blk_1073741898_1074, type=LAST_IN_PIPELINE java.lang.Object.wait(Native Method) java.lang.Object.wait(Object.java:502) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.waitForAckHead(BlockReceiver.java:1327) org.apache.hadoop.hdfs.server.datanode.BlockReceiver$PacketResponder.run(BlockReceiver.java:1399) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39944 [Waiting for operation #23] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11201998-shared-pool-2 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:34008 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33954 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512316c17c39d8ac84c7ba8156bc5bab01b44 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: hconnection-0x11201998-shared-pool-4 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_188037256_17 at /127.0.0.1:40026 [Waiting for operation #22] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33932 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33950 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11201998-shared-pool-1 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33900 [Waiting for operation #9] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33876 [Waiting for operation #12] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:40032 [Waiting for operation #40] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33952 [Waiting for operation #4] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11201998-metaLookup-shared--pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:39902 [Waiting for operation #19] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11201998-shared-pool-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33958 [Waiting for operation #5] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: ReadOnlyZKClient-127.0.0.1:58095@0x66798574-EventThread sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.park(LockSupport.java:175) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.await(AbstractQueuedSynchronizer.java:2039) java.util.concurrent.LinkedBlockingQueue.take(LinkedBlockingQueue.java:442) org.apache.zookeeper.ClientCnxn$EventThread.run(ClientCnxn.java:549) Potentially hanging thread: ResponseProcessor for block BP-1678533640-172.31.14.131-1701377595919:blk_1073741898_1074 sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:118) java.io.FilterInputStream.read(FilterInputStream.java:83) java.io.FilterInputStream.read(FilterInputStream.java:83) org.apache.hadoop.hdfs.protocolPB.PBHelperClient.vintPrefixed(PBHelperClient.java:454) org.apache.hadoop.hdfs.protocol.datatransfer.PipelineAck.readFields(PipelineAck.java:213) org.apache.hadoop.hdfs.DataStreamer$ResponseProcessor.run(DataStreamer.java:1080) Potentially hanging thread: DataStreamer for file /user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/db90f903ac074046b1a937b88abd7595 block BP-1678533640-172.31.14.131-1701377595919:blk_1073741898_1074 java.lang.Object.wait(Native Method) org.apache.hadoop.hdfs.DataStreamer.run(DataStreamer.java:678) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:33886 [Waiting for operation #10] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:34094 [Waiting for operation #6] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: hconnection-0x11201998-shared-pool-0 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: HFileArchiver-3 sun.misc.Unsafe.park(Native Method) java.util.concurrent.locks.LockSupport.parkNanos(LockSupport.java:215) java.util.concurrent.locks.AbstractQueuedSynchronizer$ConditionObject.awaitNanos(AbstractQueuedSynchronizer.java:2078) java.util.concurrent.LinkedBlockingQueue.poll(LinkedBlockingQueue.java:467) java.util.concurrent.ThreadPoolExecutor.getTask(ThreadPoolExecutor.java:1073) java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1134) java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624) java.lang.Thread.run(Thread.java:750) Potentially hanging thread: DataXceiver for client DFSClient_NONMAPREDUCE_-804064812_17 at /127.0.0.1:34006 [Waiting for operation #8] sun.nio.ch.EPollArrayWrapper.epollWait(Native Method) sun.nio.ch.EPollArrayWrapper.poll(EPollArrayWrapper.java:269) sun.nio.ch.EPollSelectorImpl.doSelect(EPollSelectorImpl.java:93) sun.nio.ch.SelectorImpl.lockAndDoSelect(SelectorImpl.java:86) sun.nio.ch.SelectorImpl.select(SelectorImpl.java:97) org.apache.hadoop.net.SocketIOWithTimeout$SelectorPool.select(SocketIOWithTimeout.java:335) org.apache.hadoop.net.SocketIOWithTimeout.doIO(SocketIOWithTimeout.java:157) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:161) org.apache.hadoop.net.SocketInputStream.read(SocketInputStream.java:131) java.io.BufferedInputStream.fill(BufferedInputStream.java:246) java.io.BufferedInputStream.read(BufferedInputStream.java:265) java.io.DataInputStream.readShort(DataInputStream.java:312) org.apache.hadoop.hdfs.protocol.datatransfer.Receiver.readOp(Receiver.java:67) org.apache.hadoop.hdfs.server.datanode.DataXceiver.run(DataXceiver.java:269) java.lang.Thread.run(Thread.java:750) - Thread LEAK? -, OpenFileDescriptor=648 (was 614) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=325 (was 302) - SystemLoadAverage LEAK? -, ProcessCount=173 (was 173), AvailableMemoryMB=7644 (was 7655) 2023-11-30 20:53:47,174 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=265, OpenFileDescriptor=648, MaxFileDescriptor=60000, SystemLoadAverage=325, ProcessCount=173, AvailableMemoryMB=7644 2023-11-30 20:53:47,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-30 20:53:47,178 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:47,179 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:53:47,179 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithWeeklyPolicy" procId is: 23 2023-11-30 20:53:47,180 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:53:47,180 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-30 20:53:47,182 DEBUG [HFileArchiver-4] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:53:47,182 DEBUG [HFileArchiver-4] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f empty. 2023-11-30 20:53:47,183 DEBUG [HFileArchiver-4] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:53:47,183 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithWeeklyPolicy regions 2023-11-30 20:53:47,196 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMinorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-30 20:53:47,197 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 96c3a18970b703bdfa44f3ff7e91565f, NAME => 'testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:53:47,282 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-30 20:53:47,483 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-30 20:53:47,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:47,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 96c3a18970b703bdfa44f3ff7e91565f, disabling compactions & flushes 2023-11-30 20:53:47,608 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:47,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:47,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. after waiting 0 ms 2023-11-30 20:53:47,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:47,608 INFO [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:47,608 DEBUG [RegionOpenAndInit-testMinorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:47,611 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:53:47,612 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701377627612"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377627612"}]},"ts":"1701377627612"} 2023-11-30 20:53:47,614 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-30 20:53:47,615 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:53:47,615 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377627615"}]},"ts":"1701377627615"} 2023-11-30 20:53:47,617 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-30 20:53:47,622 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=96c3a18970b703bdfa44f3ff7e91565f, ASSIGN}] 2023-11-30 20:53:47,623 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=96c3a18970b703bdfa44f3ff7e91565f, ASSIGN 2023-11-30 20:53:47,624 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=24, ppid=23, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=96c3a18970b703bdfa44f3ff7e91565f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:53:47,772 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/.tmp/family1/db90f903ac074046b1a937b88abd7595 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/db90f903ac074046b1a937b88abd7595 2023-11-30 20:53:47,775 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=96c3a18970b703bdfa44f3ff7e91565f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:47,775 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701377627775"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377627775"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377627775"}]},"ts":"1701377627775"} 2023-11-30 20:53:47,777 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=25, ppid=24, state=RUNNABLE; OpenRegionProcedure 96c3a18970b703bdfa44f3ff7e91565f, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:53:47,779 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in ff44000446a9095d68151bec61f51230/family1 of ff44000446a9095d68151bec61f51230 into db90f903ac074046b1a937b88abd7595(size=167.4 K), total size for store is 333.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:53:47,779 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:53:47,779 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1701377626508; duration=1sec 2023-11-30 20:53:47,779 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:47,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-30 20:53:47,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/7fe7213bbbe449daa1f6df8fef62d453, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/31b466e12c85487a982c3620b37dbf10, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/8ba4357fa9ac439bb5efec4bfb7b13a1_SeqId_47_] to archive 2023-11-30 20:53:47,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:47,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/7fe7213bbbe449daa1f6df8fef62d453 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/7fe7213bbbe449daa1f6df8fef62d453 2023-11-30 20:53:47,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/31b466e12c85487a982c3620b37dbf10 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/31b466e12c85487a982c3620b37dbf10 2023-11-30 20:53:47,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/8ba4357fa9ac439bb5efec4bfb7b13a1_SeqId_47_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/family1/8ba4357fa9ac439bb5efec4bfb7b13a1_SeqId_47_ 2023-11-30 20:53:47,929 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:47,933 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:47,933 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 96c3a18970b703bdfa44f3ff7e91565f, NAME => 'testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:53:47,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithWeeklyPolicy 96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:53:47,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:53:47,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:53:47,934 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:53:47,935 INFO [StoreOpener-96c3a18970b703bdfa44f3ff7e91565f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:53:47,937 DEBUG [StoreOpener-96c3a18970b703bdfa44f3ff7e91565f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1 2023-11-30 20:53:47,937 DEBUG [StoreOpener-96c3a18970b703bdfa44f3ff7e91565f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1 2023-11-30 20:53:47,937 INFO [StoreOpener-96c3a18970b703bdfa44f3ff7e91565f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 96c3a18970b703bdfa44f3ff7e91565f columnFamilyName family1 2023-11-30 20:53:47,939 INFO [StoreOpener-96c3a18970b703bdfa44f3ff7e91565f-1] regionserver.HStore(310): Store=96c3a18970b703bdfa44f3ff7e91565f/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:53:47,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:53:47,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:53:47,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:53:47,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:53:47,945 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 96c3a18970b703bdfa44f3ff7e91565f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73670436, jitterRate=0.09777504205703735}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:53:47,946 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:47,946 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f., pid=25, masterSystemTime=1701377627929 2023-11-30 20:53:47,948 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:47,948 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:47,949 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=24 updating hbase:meta row=96c3a18970b703bdfa44f3ff7e91565f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:47,949 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701377627949"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377627949"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377627949"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377627949"}]},"ts":"1701377627949"} 2023-11-30 20:53:47,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=25, resume processing ppid=24 2023-11-30 20:53:47,952 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=25, ppid=24, state=SUCCESS; OpenRegionProcedure 96c3a18970b703bdfa44f3ff7e91565f, server=jenkins-hbase4.apache.org,40365,1701377600631 in 173 msec 2023-11-30 20:53:47,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=24, resume processing ppid=23 2023-11-30 20:53:47,955 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=24, ppid=23, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithWeeklyPolicy, region=96c3a18970b703bdfa44f3ff7e91565f, ASSIGN in 330 msec 2023-11-30 20:53:47,956 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:53:47,956 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377627956"}]},"ts":"1701377627956"} 2023-11-30 20:53:47,958 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-30 20:53:47,961 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=23, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:53:47,962 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=23, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithWeeklyPolicy in 785 msec 2023-11-30 20:53:48,286 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=23 2023-11-30 20:53:48,286 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithWeeklyPolicy, procId: 23 completed 2023-11-30 20:53:48,311 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:48,313 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:48,313 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:48,313 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:48,313 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:48,313 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:48,313 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:48,313 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:48,316 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:48,316 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:48,316 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:48,316 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:48,316 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:48,316 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:48,317 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:48,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:48,317 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:48,317 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:48,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:48,318 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:48,318 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:48,319 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-30 20:53:48,739 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130adfe9630d98f486fa9b618deeaa88388 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151130adfe9630d98f486fa9b618deeaa88388 2023-11-30 20:53:49,144 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/e2b01f69dae7437db9824846dcd37d47 2023-11-30 20:53:49,151 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/e2b01f69dae7437db9824846dcd37d47 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/e2b01f69dae7437db9824846dcd37d47 2023-11-30 20:53:49,156 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/e2b01f69dae7437db9824846dcd37d47, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-30 20:53:49,158 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 838ms, sequenceid=5, compaction requested=false 2023-11-30 20:53:49,158 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:49,158 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:49,158 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:49,160 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,160 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:49,160 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,161 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:49,161 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,162 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:49,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:49,162 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3bb60df8[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:49,162 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:49,162 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,164 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,164 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,164 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:49,164 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,164 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:49,166 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,166 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:49,166 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:49,166 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:49,166 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:49,167 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,168 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:49,168 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:49,168 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:49,168 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:49,168 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:49,168 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,168 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:49,171 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,171 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:49,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,171 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:49,171 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:49,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:49,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:49,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,173 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,173 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:49,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,174 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,176 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,176 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:49,176 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,176 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:49,176 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,176 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:49,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:49,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:49,176 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:49,176 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:49,176 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,177 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,177 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,177 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,177 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:49,177 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:49,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:49,177 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:49,277 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:49,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:49,283 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:49,284 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:49,285 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,285 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:49,285 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:49,285 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:49,285 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:49,285 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,285 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,287 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:49,287 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,287 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:49,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:49,288 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:49,288 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,288 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:49,288 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,289 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,289 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:53:49,289 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:49,289 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:49,289 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:49,289 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:49,289 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:49,289 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:49,289 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:49,289 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:49,289 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-30 20:53:49,703 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128626b3a0f0ab241daa4a18e50e6dd59ca to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151128626b3a0f0ab241daa4a18e50e6dd59ca 2023-11-30 20:53:50,110 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/9d985f717e31461b8eb6089139b8d297 2023-11-30 20:53:50,116 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/9d985f717e31461b8eb6089139b8d297 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9d985f717e31461b8eb6089139b8d297 2023-11-30 20:53:50,121 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9d985f717e31461b8eb6089139b8d297, entries=1, sequenceid=9, filesize=5.0 K 2023-11-30 20:53:50,122 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 833ms, sequenceid=9, compaction requested=false 2023-11-30 20:53:50,122 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:50,122 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:50,122 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:50,122 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:50,122 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,122 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:50,122 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:50,133 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,133 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:50,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:50,133 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,133 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:50,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:50,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:50,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,135 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:50,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:50,135 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@23a441a9[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:50,135 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:50,135 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,137 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,137 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,137 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:50,137 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:50,137 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:50,137 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,137 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:50,138 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:50,138 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,138 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:50,139 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:50,139 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,140 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,141 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:50,141 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:50,141 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:50,142 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:50,142 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:50,142 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,142 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:50,143 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,143 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,143 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,143 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:50,144 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:50,144 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:50,144 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:50,145 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,146 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:50,146 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,147 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,149 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:50,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:50,150 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:50,150 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:50,150 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,150 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:50,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:50,250 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:50,252 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:50,256 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:50,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:50,258 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,258 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:50,258 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:50,258 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:50,258 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:50,259 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,259 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,261 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:50,261 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,261 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:50,261 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:50,261 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:50,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,262 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:50,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,262 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,263 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:53:50,263 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:50,263 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:50,263 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:50,263 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:50,264 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:50,682 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201d11be104fcd94f56848d3515726193bd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201d11be104fcd94f56848d3515726193bd 2023-11-30 20:53:51,089 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/3df70ab10c1642dab4df8a1cb44d7b13 2023-11-30 20:53:51,096 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/3df70ab10c1642dab4df8a1cb44d7b13 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/3df70ab10c1642dab4df8a1cb44d7b13 2023-11-30 20:53:51,101 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/3df70ab10c1642dab4df8a1cb44d7b13, entries=1, sequenceid=13, filesize=4.9 K 2023-11-30 20:53:51,102 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 839ms, sequenceid=13, compaction requested=true 2023-11-30 20:53:51,102 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:51,103 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:51,103 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:51,103 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:51,103 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,103 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:51,103 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:51,105 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,105 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:51,105 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,105 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:51,105 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:51,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:51,107 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@48fd5fb4[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:51,107 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:51,107 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,108 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,108 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:51,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:51,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:51,108 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,108 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:51,111 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:51,111 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,111 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:51,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:51,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:51,111 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:51,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:51,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:51,114 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:51,114 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:51,114 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:51,114 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:51,114 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,114 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:51,115 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,115 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:51,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,116 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:51,116 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:51,116 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,116 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:51,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,118 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:51,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,120 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,120 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,120 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:51,120 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,120 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:51,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:51,121 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:51,120 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:51,121 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:51,121 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,121 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,121 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,121 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:51,121 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:51,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:51,121 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,121 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:51,221 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:51,223 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:51,227 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:51,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:51,229 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,229 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:51,229 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:51,229 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:51,229 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:51,230 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,230 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,231 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,231 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:51,231 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:51,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:51,231 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:51,231 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:51,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,232 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:51,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,233 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,233 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:53:51,233 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:51,233 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:51,233 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:51,233 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:51,233 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:51,233 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:51,233 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:51,233 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:51,233 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:51,649 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205ca38fd7d90bf4cb6be6f843a7657c2d8 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca38fd7d90bf4cb6be6f843a7657c2d8 2023-11-30 20:53:52,055 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/812ed0c654b449069011060433561557 2023-11-30 20:53:52,061 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/812ed0c654b449069011060433561557 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/812ed0c654b449069011060433561557 2023-11-30 20:53:52,067 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/812ed0c654b449069011060433561557, entries=1, sequenceid=17, filesize=4.9 K 2023-11-30 20:53:52,068 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 835ms, sequenceid=17, compaction requested=true 2023-11-30 20:53:52,068 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:52,068 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:52,068 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:52,071 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,071 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:52,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:52,072 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,072 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:52,072 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,073 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:52,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:52,073 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4b0690df[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:52,073 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:52,073 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,075 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,075 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,075 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,075 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:52,075 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:52,075 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:52,075 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,075 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:52,076 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,076 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:52,076 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:52,076 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:52,077 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:52,077 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,078 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,079 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:52,079 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:52,079 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:52,079 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:52,079 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:52,079 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,079 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:52,081 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,081 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:52,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,081 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:52,081 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:52,081 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:52,082 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,082 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:52,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,083 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,083 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:52,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,084 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,089 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,089 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:52,089 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,089 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:52,089 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,089 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,089 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:52,089 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:53:52,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:52,089 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:52,089 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:52,089 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,089 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:52,089 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,089 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,090 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:52,090 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:52,090 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:52,090 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:52,190 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:52,191 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:52,195 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:52,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:52,197 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,197 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:52,197 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:52,197 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:52,197 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:52,198 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,198 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,199 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:52,199 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,199 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:52,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:52,200 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:52,200 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:52,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,200 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:52,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,201 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,204 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:53:52,204 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:52,204 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:52,204 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:52,204 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:52,204 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:52,204 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:52,205 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:52,205 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:52,205 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:52,621 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512286e4aac46c6e64c05b98e052b00d50d60 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286e4aac46c6e64c05b98e052b00d50d60 2023-11-30 20:53:53,027 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/d9f776483d0249578034d80a8daf75f5 2023-11-30 20:53:53,033 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/d9f776483d0249578034d80a8daf75f5 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/d9f776483d0249578034d80a8daf75f5 2023-11-30 20:53:53,039 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/d9f776483d0249578034d80a8daf75f5, entries=1, sequenceid=21, filesize=4.9 K 2023-11-30 20:53:53,040 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 835ms, sequenceid=21, compaction requested=true 2023-11-30 20:53:53,040 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:53,040 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:53,040 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:53,042 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,042 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:53,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:53,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:53,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:53,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:53,045 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@40d48d8a[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:53,045 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:53,045 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,046 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,046 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,047 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:53,047 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:53,047 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:53,047 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,047 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:53,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:53,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:53,048 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:53,049 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:53,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:53,050 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,051 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:53,051 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:53,051 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:53,051 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:53,052 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:53,052 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,052 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:53,055 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,055 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:53,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,055 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,055 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:53,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:53,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:53,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:53,055 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:53,056 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,056 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,057 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,057 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,058 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:53,060 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,060 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:53:53,060 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,060 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:53,060 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:53,061 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:53,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:53,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:53,161 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:53,162 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:53,167 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:53,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:53,168 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,168 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:53,168 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:53,168 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:53,168 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:53,169 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,169 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,170 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,170 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:53,171 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:53,171 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:53,171 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:53,171 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,171 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:53,172 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,172 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,172 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:53:53,172 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:53,172 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:53,172 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:53,172 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:53,172 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:53,172 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:53,172 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:53,172 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:53,173 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:53,474 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:53:53,588 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231293400aff5c84b17bb20946c76033d56 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231293400aff5c84b17bb20946c76033d56 2023-11-30 20:53:53,993 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/732f21e2b7d94af7b1ba8bb7c786eb19 2023-11-30 20:53:54,000 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/732f21e2b7d94af7b1ba8bb7c786eb19 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/732f21e2b7d94af7b1ba8bb7c786eb19 2023-11-30 20:53:54,005 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/732f21e2b7d94af7b1ba8bb7c786eb19, entries=1, sequenceid=25, filesize=4.9 K 2023-11-30 20:53:54,006 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 833ms, sequenceid=25, compaction requested=true 2023-11-30 20:53:54,006 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:54,006 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:54,006 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:54,006 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:54,006 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,006 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:54,006 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:54,008 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,008 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:54,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:54,008 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,008 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:54,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:54,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:54,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,010 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:54,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:54,010 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@41fc2530[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:54,010 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:54,010 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,012 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,012 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,013 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,013 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:54,013 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:54,013 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:54,013 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,013 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:54,014 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,014 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:54,014 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:54,014 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:54,015 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:54,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:54,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:54,015 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:54,016 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,017 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:54,017 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:54,017 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:54,017 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:54,017 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:54,017 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,017 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:54,019 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,019 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,019 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:54,019 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:54,019 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,020 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:54,020 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,020 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:54,021 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,022 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:54,022 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,023 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,024 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,024 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,024 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,024 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,024 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,024 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,025 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:54,025 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:54,025 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:54,025 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:54,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:54,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:54,025 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:54,025 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:54,025 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:54,025 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:54,025 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:54,125 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:54,126 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:54,131 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:54,132 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:54,133 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,133 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:54,133 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:54,133 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:54,133 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:54,133 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,133 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,136 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:54,136 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,136 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:54,136 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:54,137 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,137 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:54,137 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:54,137 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,137 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,138 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:53:54,138 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,138 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:54,138 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:54,138 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:54,138 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:54,138 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:54,138 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:54,138 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:54,138 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:54,555 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010177695b3153fc41f88f93ced27c1741dc to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010177695b3153fc41f88f93ced27c1741dc 2023-11-30 20:53:54,961 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/0358f70003bb410ca03a3364cac77be7 2023-11-30 20:53:54,967 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/0358f70003bb410ca03a3364cac77be7 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/0358f70003bb410ca03a3364cac77be7 2023-11-30 20:53:54,972 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/0358f70003bb410ca03a3364cac77be7, entries=1, sequenceid=29, filesize=4.9 K 2023-11-30 20:53:54,973 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 835ms, sequenceid=29, compaction requested=true 2023-11-30 20:53:54,973 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:54,973 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:54,973 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:54,973 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:54,973 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,973 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:54,973 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:54,975 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,975 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:54,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:54,976 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:54,976 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:54,976 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:54,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:54,977 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@63dec244[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:54,977 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:54,978 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,979 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,979 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,979 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:54,979 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:54,979 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,979 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:54,979 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:54,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:54,981 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:54,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:54,981 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:54,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:54,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:54,984 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:54,984 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:54,984 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:54,984 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:54,984 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,984 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:54,989 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,990 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:54,990 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:54,990 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:54,990 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:54,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:54,991 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,992 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:54,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,994 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,994 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,994 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,994 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:54,994 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,994 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:54,994 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:54,994 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:53:54,994 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:54,994 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:54,994 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:54,995 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:54,994 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:54,995 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:54,995 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:54,995 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:54,995 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:54,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:55,095 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:55,096 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:55,101 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:55,103 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:55,104 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,104 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:55,104 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:55,104 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:55,104 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:55,104 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,104 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,106 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,106 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:55,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:55,106 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,106 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:55,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,107 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:55,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,107 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,107 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:53:55,107 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:55,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:55,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:55,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:55,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:55,108 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:55,108 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:55,108 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:55,522 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103ec92938aa3e14904b5950e672b828c6d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ec92938aa3e14904b5950e672b828c6d 2023-11-30 20:53:55,928 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/f2b7f0f7c26e42d0b1dbf628f84b00f7 2023-11-30 20:53:55,934 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/f2b7f0f7c26e42d0b1dbf628f84b00f7 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f2b7f0f7c26e42d0b1dbf628f84b00f7 2023-11-30 20:53:55,939 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f2b7f0f7c26e42d0b1dbf628f84b00f7, entries=1, sequenceid=33, filesize=4.9 K 2023-11-30 20:53:55,940 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 832ms, sequenceid=33, compaction requested=true 2023-11-30 20:53:55,940 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:55,940 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:55,940 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:55,940 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:55,940 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,940 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:55,940 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:55,942 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,942 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:55,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:55,943 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,943 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:55,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:55,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:55,944 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:55,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1c213688[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:55,945 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:55,945 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,947 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,947 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:55,947 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:55,947 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:55,947 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,947 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:55,949 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,949 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:55,949 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:55,949 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:55,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:55,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,951 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:55,952 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:55,952 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:55,952 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:55,952 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:55,952 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,952 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:55,954 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,954 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:55,954 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:55,954 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:55,954 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:55,954 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:55,955 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,956 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:55,956 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,957 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,958 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,958 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,958 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,958 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:55,958 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:55,958 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,958 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:55,958 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:55,958 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:53:55,958 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:55,959 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:55,958 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,958 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:55,958 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:55,959 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:55,959 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:55,959 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:55,959 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:55,959 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:56,059 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:56,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:56,065 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:56,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:56,066 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,067 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:56,067 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:56,067 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:56,067 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:56,067 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,067 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,069 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:56,069 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,069 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:56,070 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,070 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:56,070 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,070 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:56,071 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,071 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,071 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:53:56,071 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,071 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:56,071 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:56,071 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:56,071 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:56,071 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:56,071 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:56,071 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:56,071 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:56,485 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907146046fbd70e4419b14196e3f933e8d4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20150907146046fbd70e4419b14196e3f933e8d4 2023-11-30 20:53:56,891 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/f5772071e74840b79f9a6a4a9660ee37 2023-11-30 20:53:56,897 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/f5772071e74840b79f9a6a4a9660ee37 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f5772071e74840b79f9a6a4a9660ee37 2023-11-30 20:53:56,902 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f5772071e74840b79f9a6a4a9660ee37, entries=1, sequenceid=37, filesize=4.9 K 2023-11-30 20:53:56,903 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 832ms, sequenceid=37, compaction requested=true 2023-11-30 20:53:56,903 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:56,903 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:56,903 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:56,903 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:56,903 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,903 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:56,903 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:56,905 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,905 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:56,905 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:56,906 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:56,906 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:56,906 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:56,907 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@787d405b[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:56,907 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:56,908 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,909 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,909 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:56,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:56,909 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:56,909 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,909 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:56,911 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,911 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:56,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:56,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:56,911 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:56,911 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:56,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:56,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:56,914 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:56,914 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:56,914 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:56,914 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:56,914 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,914 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:56,916 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,916 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:56,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,916 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:56,917 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:56,917 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:56,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,918 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:56,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:56,921 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:56,921 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:56,921 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:56,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:56,921 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:56,921 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:56,922 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:56,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:56,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:57,022 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:57,023 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:57,027 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:53:57,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:53:57,029 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,029 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:57,029 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:57,029 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:53:57,029 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:53:57,030 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,030 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,031 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:57,031 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:57,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:57,032 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,032 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:53:57,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,032 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:53:57,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,033 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:53:57,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,033 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:53:57,033 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:53:57,033 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:53:57,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:53:57,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:53:57,034 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:57,034 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. started... 2023-11-30 20:53:57,034 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 96c3a18970b703bdfa44f3ff7e91565f 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:53:57,449 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511206d1ea15b01cf42309c5345e17c3f48a7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201511206d1ea15b01cf42309c5345e17c3f48a7 2023-11-30 20:53:57,856 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/bcc37ded23e9462fb505db33d63744f6 2023-11-30 20:53:57,862 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/bcc37ded23e9462fb505db33d63744f6 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/bcc37ded23e9462fb505db33d63744f6 2023-11-30 20:53:57,867 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/bcc37ded23e9462fb505db33d63744f6, entries=1, sequenceid=41, filesize=4.9 K 2023-11-30 20:53:57,868 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 96c3a18970b703bdfa44f3ff7e91565f in 834ms, sequenceid=41, compaction requested=true 2023-11-30 20:53:57,868 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:57,868 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:57,868 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:53:57,868 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:53:57,868 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,868 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:53:57,868 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:53:57,873 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,873 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:57,874 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,874 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:57,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:57,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:53:57,875 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@58883fc1[Count = 0] remaining members to acquire global barrier 2023-11-30 20:53:57,875 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:53:57,875 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,877 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,877 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:53:57,877 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:53:57,877 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:53:57,877 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,877 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:53:57,879 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:53:57,879 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,879 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:57,879 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:57,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:57,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:57,880 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:53:57,881 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:53:57,881 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:53:57,881 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:53:57,881 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:53:57,881 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,881 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:53:57,883 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,883 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:53:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:53:57,883 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,883 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:53:57,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:57,884 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:53:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,885 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:53:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,889 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,889 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,889 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:53:57,889 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:53:57,889 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:53:57,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:53:57,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:53:57,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithWeeklyPolicy' 2023-11-30 20:53:57,889 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:53:57,889 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:53:57,889 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:53:57,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:53:57,889 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:53:57,890 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:53:57,890 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:53:57,890 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,890 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,890 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,990 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:53:57,991 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:53:57,993 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMinorCompactionWithWeeklyPolicy 2023-11-30 20:53:57,995 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:53:57,996 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=26, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:53:57,997 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=26, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378237997 2023-11-30 20:53:57,997 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:53:57,998 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-30 20:53:58,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 0 del files, 9 selected files, and 0 irrelevant files table 'testMinorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-30 20:53:58,000 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:53:58,002 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x584467bc to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:53:58,007 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3e4d04c9, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:53:58,007 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:58,454 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601034266b240d85545f3af592c77cab20290 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201601034266b240d85545f3af592c77cab20290 2023-11-30 20:53:58,455 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:53:58,468 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:53:58,469 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45426, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:53:58,477 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:53:58,478 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40154, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:53:58,488 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/45eca85f8b6949e88646eca53b1fd895 first=Optional[r3] last=Optional[r6] 2023-11-30 20:53:58,488 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/45eca85f8b6949e88646eca53b1fd895}] 2023-11-30 20:53:58,493 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/45eca85f8b6949e88646eca53b1fd895 for inclusion in 96c3a18970b703bdfa44f3ff7e91565f/family1 2023-11-30 20:53:58,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-30 20:53:58,496 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:53:58,497 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:58,498 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/45eca85f8b6949e88646eca53b1fd895 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s4sus8di3dgn1ov80bu51kcavs79v4l3bol4b6o5e9tpekak08bl5ua5alldckbr/family1/45eca85f8b6949e88646eca53b1fd895 2023-11-30 20:53:58,501 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s4sus8di3dgn1ov80bu51kcavs79v4l3bol4b6o5e9tpekak08bl5ua5alldckbr/family1/45eca85f8b6949e88646eca53b1fd895 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c0100d1462e24d1291378e675c8651e6_SeqId_44_ 2023-11-30 20:53:58,502 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s4sus8di3dgn1ov80bu51kcavs79v4l3bol4b6o5e9tpekak08bl5ua5alldckbr/family1/45eca85f8b6949e88646eca53b1fd895 into 96c3a18970b703bdfa44f3ff7e91565f/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c0100d1462e24d1291378e675c8651e6_SeqId_44_ - updating store file list. 2023-11-30 20:53:58,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c0100d1462e24d1291378e675c8651e6_SeqId_44_ into 96c3a18970b703bdfa44f3ff7e91565f/family1 2023-11-30 20:53:58,507 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s4sus8di3dgn1ov80bu51kcavs79v4l3bol4b6o5e9tpekak08bl5ua5alldckbr/family1/45eca85f8b6949e88646eca53b1fd895 into 96c3a18970b703bdfa44f3ff7e91565f/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c0100d1462e24d1291378e675c8651e6_SeqId_44_) 2023-11-30 20:53:58,507 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__s4sus8di3dgn1ov80bu51kcavs79v4l3bol4b6o5e9tpekak08bl5ua5alldckbr/family1/45eca85f8b6949e88646eca53b1fd895 2023-11-30 20:53:58,508 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-30 20:53:58,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-30 20:53:58,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): 96c3a18970b703bdfa44f3ff7e91565f/family1 is initiating minor compaction 2023-11-30 20:53:58,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@7a42dc70; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:58,512 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 96c3a18970b703bdfa44f3ff7e91565f/family1 in testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:58,513 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9d985f717e31461b8eb6089139b8d297, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/3df70ab10c1642dab4df8a1cb44d7b13, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/812ed0c654b449069011060433561557, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/d9f776483d0249578034d80a8daf75f5, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/732f21e2b7d94af7b1ba8bb7c786eb19, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/0358f70003bb410ca03a3364cac77be7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f2b7f0f7c26e42d0b1dbf628f84b00f7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f5772071e74840b79f9a6a4a9660ee37, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/bcc37ded23e9462fb505db33d63744f6, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c0100d1462e24d1291378e675c8651e6_SeqId_44_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp, totalSize=50.0 K 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 9d985f717e31461b8eb6089139b8d297, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 3df70ab10c1642dab4df8a1cb44d7b13, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 812ed0c654b449069011060433561557, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting d9f776483d0249578034d80a8daf75f5, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 732f21e2b7d94af7b1ba8bb7c786eb19, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 0358f70003bb410ca03a3364cac77be7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting f2b7f0f7c26e42d0b1dbf628f84b00f7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting f5772071e74840b79f9a6a4a9660ee37, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting bcc37ded23e9462fb505db33d63744f6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-30 20:53:58,513 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting c0100d1462e24d1291378e675c8651e6_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-30 20:53:58,515 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:53:58,516 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:58,519 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286e4aac46c6e64c05b98e052b00d50d60 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512286e4aac46c6e64c05b98e052b00d50d60 2023-11-30 20:53:58,520 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231293400aff5c84b17bb20946c76033d56 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151231293400aff5c84b17bb20946c76033d56 2023-11-30 20:53:58,521 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010177695b3153fc41f88f93ced27c1741dc to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e2016010177695b3153fc41f88f93ced27c1741dc 2023-11-30 20:53:58,523 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ec92938aa3e14904b5950e672b828c6d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20160103ec92938aa3e14904b5950e672b828c6d 2023-11-30 20:53:58,523 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-30 20:53:58,523 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-30 20:53:58,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:58,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:58,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:58,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:58,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:58,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:58,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:58,524 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:58,555 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 96c3a18970b703bdfa44f3ff7e91565f#family1#compaction#34 average throughput is 0.45 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:53:59,366 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512055fa3896a11ed4d508edc6cff01016aa5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e201512055fa3896a11ed4d508edc6cff01016aa5 2023-11-30 20:53:59,367 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:53:59,373 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/9ec5fde4d2ff4afe96ea43b02480c1da as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9ec5fde4d2ff4afe96ea43b02480c1da 2023-11-30 20:53:59,380 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 96c3a18970b703bdfa44f3ff7e91565f/family1 of 96c3a18970b703bdfa44f3ff7e91565f into 9ec5fde4d2ff4afe96ea43b02480c1da(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:53:59,380 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:59,381 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1701377638512; duration=0sec 2023-11-30 20:53:59,381 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:59,396 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f96a1361ca36430fb5fc5d3273088c50 first=Optional[r1] last=Optional[r2] 2023-11-30 20:53:59,397 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f96a1361ca36430fb5fc5d3273088c50}] 2023-11-30 20:53:59,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f96a1361ca36430fb5fc5d3273088c50 for inclusion in 96c3a18970b703bdfa44f3ff7e91565f/family1 2023-11-30 20:53:59,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-30 20:53:59,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:53:59,404 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:53:59,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/f96a1361ca36430fb5fc5d3273088c50 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__437eg50jgimc889i8dh7k3gs7ni471t83uv2t5t696boavimarlrreo2lc6knppu/family1/f96a1361ca36430fb5fc5d3273088c50 2023-11-30 20:53:59,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__437eg50jgimc889i8dh7k3gs7ni471t83uv2t5t696boavimarlrreo2lc6knppu/family1/f96a1361ca36430fb5fc5d3273088c50 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c3386926f1a6461d972d48d1d6bb091b_SeqId_47_ 2023-11-30 20:53:59,408 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__437eg50jgimc889i8dh7k3gs7ni471t83uv2t5t696boavimarlrreo2lc6knppu/family1/f96a1361ca36430fb5fc5d3273088c50 into 96c3a18970b703bdfa44f3ff7e91565f/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c3386926f1a6461d972d48d1d6bb091b_SeqId_47_ - updating store file list. 2023-11-30 20:53:59,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9d985f717e31461b8eb6089139b8d297, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/3df70ab10c1642dab4df8a1cb44d7b13, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/812ed0c654b449069011060433561557, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/d9f776483d0249578034d80a8daf75f5, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/732f21e2b7d94af7b1ba8bb7c786eb19, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/0358f70003bb410ca03a3364cac77be7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f2b7f0f7c26e42d0b1dbf628f84b00f7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f5772071e74840b79f9a6a4a9660ee37, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/bcc37ded23e9462fb505db33d63744f6, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c0100d1462e24d1291378e675c8651e6_SeqId_44_] to archive 2023-11-30 20:53:59,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:59,425 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c3386926f1a6461d972d48d1d6bb091b_SeqId_47_ into 96c3a18970b703bdfa44f3ff7e91565f/family1 2023-11-30 20:53:59,426 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__437eg50jgimc889i8dh7k3gs7ni471t83uv2t5t696boavimarlrreo2lc6knppu/family1/f96a1361ca36430fb5fc5d3273088c50 into 96c3a18970b703bdfa44f3ff7e91565f/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c3386926f1a6461d972d48d1d6bb091b_SeqId_47_) 2023-11-30 20:53:59,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithWeeklyPolicy__437eg50jgimc889i8dh7k3gs7ni471t83uv2t5t696boavimarlrreo2lc6knppu/family1/f96a1361ca36430fb5fc5d3273088c50 2023-11-30 20:53:59,426 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-30 20:53:59,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9d985f717e31461b8eb6089139b8d297 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9d985f717e31461b8eb6089139b8d297 2023-11-30 20:53:59,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 181014 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-30 20:53:59,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): 96c3a18970b703bdfa44f3ff7e91565f/family1 is initiating minor compaction (all files) 2023-11-30 20:53:59,428 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@43cef071; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:53:59,428 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 96c3a18970b703bdfa44f3ff7e91565f/family1 in testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:53:59,428 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/e2b01f69dae7437db9824846dcd37d47, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9ec5fde4d2ff4afe96ea43b02480c1da, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c3386926f1a6461d972d48d1d6bb091b_SeqId_47_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp, totalSize=176.8 K 2023-11-30 20:53:59,429 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting e2b01f69dae7437db9824846dcd37d47, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824433 2023-11-30 20:53:59,430 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/3df70ab10c1642dab4df8a1cb44d7b13 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/3df70ab10c1642dab4df8a1cb44d7b13 2023-11-30 20:53:59,430 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 9ec5fde4d2ff4afe96ea43b02480c1da, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224433 2023-11-30 20:53:59,430 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting c3386926f1a6461d972d48d1d6bb091b_SeqId_47_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224433 2023-11-30 20:53:59,431 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:53:59,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/812ed0c654b449069011060433561557 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/812ed0c654b449069011060433561557 2023-11-30 20:53:59,432 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:53:59,433 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/d9f776483d0249578034d80a8daf75f5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/d9f776483d0249578034d80a8daf75f5 2023-11-30 20:53:59,435 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201d11be104fcd94f56848d3515726193bd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151201d11be104fcd94f56848d3515726193bd 2023-11-30 20:53:59,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/732f21e2b7d94af7b1ba8bb7c786eb19 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/732f21e2b7d94af7b1ba8bb7c786eb19 2023-11-30 20:53:59,437 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/0358f70003bb410ca03a3364cac77be7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/0358f70003bb410ca03a3364cac77be7 2023-11-30 20:53:59,439 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f2b7f0f7c26e42d0b1dbf628f84b00f7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f2b7f0f7c26e42d0b1dbf628f84b00f7 2023-11-30 20:53:59,440 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f5772071e74840b79f9a6a4a9660ee37 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/f5772071e74840b79f9a6a4a9660ee37 2023-11-30 20:53:59,442 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca38fd7d90bf4cb6be6f843a7657c2d8 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/fde9c8e8f2088680fca8c7a0bcc19fe9/family1/d41d8cd98f00b204e9800998ecf8427e20151205ca38fd7d90bf4cb6be6f843a7657c2d8 2023-11-30 20:53:59,442 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/bcc37ded23e9462fb505db33d63744f6 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/bcc37ded23e9462fb505db33d63744f6 2023-11-30 20:53:59,442 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithWeeklyPolicy 2 expired mob files are deleted 2023-11-30 20:53:59,442 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-30 20:53:59,443 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMinorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:53:59,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMinorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:53:59,443 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithWeeklyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:53:59,444 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=26, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:53:59,445 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c0100d1462e24d1291378e675c8651e6_SeqId_44_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c0100d1462e24d1291378e675c8651e6_SeqId_44_ 2023-11-30 20:53:59,446 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=26, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4500 sec 2023-11-30 20:53:59,453 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 96c3a18970b703bdfa44f3ff7e91565f#family1#compaction#35 average throughput is 12.89 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:53:59,560 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithWeeklyPolicy Thread=260 (was 265), OpenFileDescriptor=638 (was 648), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=291 (was 325), ProcessCount=173 (was 173), AvailableMemoryMB=7612 (was 7644) 2023-11-30 20:53:59,572 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=260, OpenFileDescriptor=638, MaxFileDescriptor=60000, SystemLoadAverage=291, ProcessCount=173, AvailableMemoryMB=7612 2023-11-30 20:53:59,574 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-30 20:53:59,576 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles 2023-11-30 20:53:59,578 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:53:59,578 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testScannerOnBulkLoadRefHFiles" procId is: 27 2023-11-30 20:53:59,579 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-30 20:53:59,579 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:53:59,582 DEBUG [HFileArchiver-5] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:53:59,582 DEBUG [HFileArchiver-6] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:53:59,584 DEBUG [HFileArchiver-5] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840 empty. 2023-11-30 20:53:59,584 DEBUG [HFileArchiver-7] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:53:59,585 DEBUG [HFileArchiver-6] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7 empty. 2023-11-30 20:53:59,585 DEBUG [HFileArchiver-7] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576 empty. 2023-11-30 20:53:59,585 DEBUG [HFileArchiver-5] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:53:59,585 DEBUG [HFileArchiver-6] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:53:59,585 DEBUG [HFileArchiver-7] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:53:59,585 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived testScannerOnBulkLoadRefHFiles regions 2023-11-30 20:53:59,680 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-30 20:53:59,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-30 20:53:59,995 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testScannerOnBulkLoadRefHFiles/.tabledesc/.tableinfo.0000000001 2023-11-30 20:53:59,997 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(7675): creating {ENCODED => 92b8e7e210d6609106b2d5a4e07ee576, NAME => 'testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:53:59,997 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3361defc3633e70b83e7f7d3d89134c7, NAME => 'testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:53:59,997 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(7675): creating {ENCODED => 550ab1f8254e7dfd3c43a65727cb6840, NAME => 'testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testScannerOnBulkLoadRefHFiles', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:54:00,183 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-30 20:54:00,404 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:00,404 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1604): Closing 3361defc3633e70b83e7f7d3d89134c7, disabling compactions & flushes 2023-11-30 20:54:00,404 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:00,404 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:00,405 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. after waiting 0 ms 2023-11-30 20:54:00,405 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:00,405 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:00,405 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-1] regionserver.HRegion(1558): Region close journal for 3361defc3633e70b83e7f7d3d89134c7: 2023-11-30 20:54:00,410 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:00,410 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1604): Closing 92b8e7e210d6609106b2d5a4e07ee576, disabling compactions & flushes 2023-11-30 20:54:00,410 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:00,410 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:00,410 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. after waiting 0 ms 2023-11-30 20:54:00,410 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:00,410 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:00,410 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:00,411 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-2] regionserver.HRegion(1558): Region close journal for 92b8e7e210d6609106b2d5a4e07ee576: 2023-11-30 20:54:00,411 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1604): Closing 550ab1f8254e7dfd3c43a65727cb6840, disabling compactions & flushes 2023-11-30 20:54:00,411 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:00,411 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:00,411 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. after waiting 0 ms 2023-11-30 20:54:00,411 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:00,411 INFO [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:00,411 DEBUG [RegionOpenAndInit-testScannerOnBulkLoadRefHFiles-pool-0] regionserver.HRegion(1558): Region close journal for 550ab1f8254e7dfd3c43a65727cb6840: 2023-11-30 20:54:00,413 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:54:00,414 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701377640414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377640414"}]},"ts":"1701377640414"} 2023-11-30 20:54:00,415 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701377640414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377640414"}]},"ts":"1701377640414"} 2023-11-30 20:54:00,415 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701377640414"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377640414"}]},"ts":"1701377640414"} 2023-11-30 20:54:00,417 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-30 20:54:00,418 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:54:00,418 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377640418"}]},"ts":"1701377640418"} 2023-11-30 20:54:00,420 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLING in hbase:meta 2023-11-30 20:54:00,424 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=550ab1f8254e7dfd3c43a65727cb6840, ASSIGN}, {pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3361defc3633e70b83e7f7d3d89134c7, ASSIGN}, {pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=92b8e7e210d6609106b2d5a4e07ee576, ASSIGN}] 2023-11-30 20:54:00,425 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3361defc3633e70b83e7f7d3d89134c7, ASSIGN 2023-11-30 20:54:00,425 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=92b8e7e210d6609106b2d5a4e07ee576, ASSIGN 2023-11-30 20:54:00,425 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=550ab1f8254e7dfd3c43a65727cb6840, ASSIGN 2023-11-30 20:54:00,426 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=29, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3361defc3633e70b83e7f7d3d89134c7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:00,426 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=30, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=92b8e7e210d6609106b2d5a4e07ee576, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:00,426 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=28, ppid=27, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=550ab1f8254e7dfd3c43a65727cb6840, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:00,577 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=92b8e7e210d6609106b2d5a4e07ee576, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:00,578 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=550ab1f8254e7dfd3c43a65727cb6840, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:00,577 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3361defc3633e70b83e7f7d3d89134c7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:00,578 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701377640577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377640577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377640577"}]},"ts":"1701377640577"} 2023-11-30 20:54:00,578 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701377640578"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377640578"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377640578"}]},"ts":"1701377640578"} 2023-11-30 20:54:00,578 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701377640577"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377640577"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377640577"}]},"ts":"1701377640577"} 2023-11-30 20:54:00,580 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=31, ppid=30, state=RUNNABLE; OpenRegionProcedure 92b8e7e210d6609106b2d5a4e07ee576, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:00,581 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=32, ppid=28, state=RUNNABLE; OpenRegionProcedure 550ab1f8254e7dfd3c43a65727cb6840, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:00,582 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=33, ppid=29, state=RUNNABLE; OpenRegionProcedure 3361defc3633e70b83e7f7d3d89134c7, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:00,677 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/.tmp/family1/ee42f4b2f6be4d27bf66ccb6624b3040 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/ee42f4b2f6be4d27bf66ccb6624b3040 2023-11-30 20:54:00,683 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 96c3a18970b703bdfa44f3ff7e91565f/family1 of 96c3a18970b703bdfa44f3ff7e91565f into ee42f4b2f6be4d27bf66ccb6624b3040(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:54:00,683 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:54:00,683 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f., storeName=family1, fileCount=3, fileSize=176.8 K (165.1 K, 6.6 K, 5.2 K), priority=2, time=1701377639428; duration=1sec 2023-11-30 20:54:00,683 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:00,684 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-30 20:54:00,713 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/e2b01f69dae7437db9824846dcd37d47, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9ec5fde4d2ff4afe96ea43b02480c1da, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c3386926f1a6461d972d48d1d6bb091b_SeqId_47_] to archive 2023-11-30 20:54:00,714 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:00,716 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/e2b01f69dae7437db9824846dcd37d47 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/e2b01f69dae7437db9824846dcd37d47 2023-11-30 20:54:00,717 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9ec5fde4d2ff4afe96ea43b02480c1da to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/9ec5fde4d2ff4afe96ea43b02480c1da 2023-11-30 20:54:00,718 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c3386926f1a6461d972d48d1d6bb091b_SeqId_47_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/family1/c3386926f1a6461d972d48d1d6bb091b_SeqId_47_ 2023-11-30 20:54:00,732 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:00,734 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:00,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3361defc3633e70b83e7f7d3d89134c7, NAME => 'testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7.', STARTKEY => '1', ENDKEY => '2'} 2023-11-30 20:54:00,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:54:00,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:00,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:54:00,735 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:54:00,737 INFO [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:54:00,738 DEBUG [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7/family1 2023-11-30 20:54:00,738 DEBUG [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7/family1 2023-11-30 20:54:00,738 INFO [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3361defc3633e70b83e7f7d3d89134c7 columnFamilyName family1 2023-11-30 20:54:00,740 INFO [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] regionserver.HStore(310): Store=3361defc3633e70b83e7f7d3d89134c7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:00,740 INFO [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:54:00,741 DEBUG [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7/family2 2023-11-30 20:54:00,741 DEBUG [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7/family2 2023-11-30 20:54:00,742 INFO [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3361defc3633e70b83e7f7d3d89134c7 columnFamilyName family2 2023-11-30 20:54:00,743 INFO [StoreOpener-3361defc3633e70b83e7f7d3d89134c7-1] regionserver.HStore(310): Store=3361defc3633e70b83e7f7d3d89134c7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:00,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:54:00,744 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:54:00,746 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:54:00,747 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:54:00,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:00,749 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3361defc3633e70b83e7f7d3d89134c7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62673599, jitterRate=-0.06609059870243073}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:54:00,749 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3361defc3633e70b83e7f7d3d89134c7: 2023-11-30 20:54:00,750 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7., pid=33, masterSystemTime=1701377640731 2023-11-30 20:54:00,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:00,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:00,752 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:00,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 92b8e7e210d6609106b2d5a4e07ee576, NAME => 'testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576.', STARTKEY => '2', ENDKEY => ''} 2023-11-30 20:54:00,752 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:54:00,752 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=29 updating hbase:meta row=3361defc3633e70b83e7f7d3d89134c7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:00,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:00,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:54:00,753 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7.","families":{"info":[{"qualifier":"regioninfo","vlen":66,"tag":[],"timestamp":"1701377640752"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377640752"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377640752"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377640752"}]},"ts":"1701377640752"} 2023-11-30 20:54:00,753 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:54:00,754 INFO [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:54:00,756 DEBUG [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1 2023-11-30 20:54:00,756 DEBUG [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1 2023-11-30 20:54:00,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=33, resume processing ppid=29 2023-11-30 20:54:00,756 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=33, ppid=29, state=SUCCESS; OpenRegionProcedure 3361defc3633e70b83e7f7d3d89134c7, server=jenkins-hbase4.apache.org,40365,1701377600631 in 173 msec 2023-11-30 20:54:00,756 INFO [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92b8e7e210d6609106b2d5a4e07ee576 columnFamilyName family1 2023-11-30 20:54:00,758 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=29, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=3361defc3633e70b83e7f7d3d89134c7, ASSIGN in 333 msec 2023-11-30 20:54:00,758 INFO [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] regionserver.HStore(310): Store=92b8e7e210d6609106b2d5a4e07ee576/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:00,758 INFO [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:54:00,760 DEBUG [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family2 2023-11-30 20:54:00,760 DEBUG [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family2 2023-11-30 20:54:00,761 INFO [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 92b8e7e210d6609106b2d5a4e07ee576 columnFamilyName family2 2023-11-30 20:54:00,762 INFO [StoreOpener-92b8e7e210d6609106b2d5a4e07ee576-1] regionserver.HStore(310): Store=92b8e7e210d6609106b2d5a4e07ee576/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:00,762 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:54:00,763 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:54:00,765 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:54:00,766 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:54:00,767 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:00,768 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 92b8e7e210d6609106b2d5a4e07ee576; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62057181, jitterRate=-0.07527594268321991}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:54:00,768 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 92b8e7e210d6609106b2d5a4e07ee576: 2023-11-30 20:54:00,769 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576., pid=31, masterSystemTime=1701377640731 2023-11-30 20:54:00,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:00,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:00,770 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:00,770 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 550ab1f8254e7dfd3c43a65727cb6840, NAME => 'testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840.', STARTKEY => '', ENDKEY => '1'} 2023-11-30 20:54:00,771 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=30 updating hbase:meta row=92b8e7e210d6609106b2d5a4e07ee576, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:00,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testScannerOnBulkLoadRefHFiles 550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:54:00,771 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701377640771"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377640771"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377640771"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377640771"}]},"ts":"1701377640771"} 2023-11-30 20:54:00,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:00,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:54:00,771 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:54:00,774 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=31, resume processing ppid=30 2023-11-30 20:54:00,775 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=31, ppid=30, state=SUCCESS; OpenRegionProcedure 92b8e7e210d6609106b2d5a4e07ee576, server=jenkins-hbase4.apache.org,40365,1701377600631 in 192 msec 2023-11-30 20:54:00,775 INFO [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:54:00,776 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=30, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=92b8e7e210d6609106b2d5a4e07ee576, ASSIGN in 352 msec 2023-11-30 20:54:00,777 DEBUG [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840/family1 2023-11-30 20:54:00,777 DEBUG [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840/family1 2023-11-30 20:54:00,778 INFO [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 550ab1f8254e7dfd3c43a65727cb6840 columnFamilyName family1 2023-11-30 20:54:00,779 INFO [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] regionserver.HStore(310): Store=550ab1f8254e7dfd3c43a65727cb6840/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:00,779 INFO [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:54:00,781 DEBUG [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840/family2 2023-11-30 20:54:00,781 DEBUG [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840/family2 2023-11-30 20:54:00,781 INFO [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 550ab1f8254e7dfd3c43a65727cb6840 columnFamilyName family2 2023-11-30 20:54:00,782 INFO [StoreOpener-550ab1f8254e7dfd3c43a65727cb6840-1] regionserver.HStore(310): Store=550ab1f8254e7dfd3c43a65727cb6840/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:00,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:54:00,783 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:54:00,785 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testScannerOnBulkLoadRefHFiles descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:54:00,787 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:54:00,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:00,789 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 550ab1f8254e7dfd3c43a65727cb6840; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66835512, jitterRate=-0.0040732622146606445}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:54:00,789 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 550ab1f8254e7dfd3c43a65727cb6840: 2023-11-30 20:54:00,790 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840., pid=32, masterSystemTime=1701377640731 2023-11-30 20:54:00,791 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:00,791 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:00,792 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=28 updating hbase:meta row=550ab1f8254e7dfd3c43a65727cb6840, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:00,792 WARN [RpcServer.priority.RWQ.Fifo.write.handler=0,queue=0,port=43087] assignment.AssignmentManager(1312): Unable to acquire lock for regionNode state=OPEN, location=jenkins-hbase4.apache.org,40365,1701377600631, table=testScannerOnBulkLoadRefHFiles, region=550ab1f8254e7dfd3c43a65727cb6840. It is likely that another thread is currently holding the lock. To avoid deadlock, skip execution for now. 2023-11-30 20:54:00,792 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840.","families":{"info":[{"qualifier":"regioninfo","vlen":65,"tag":[],"timestamp":"1701377640792"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377640792"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377640792"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377640792"}]},"ts":"1701377640792"} 2023-11-30 20:54:00,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=32, resume processing ppid=28 2023-11-30 20:54:00,796 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=32, ppid=28, state=SUCCESS; OpenRegionProcedure 550ab1f8254e7dfd3c43a65727cb6840, server=jenkins-hbase4.apache.org,40365,1701377600631 in 214 msec 2023-11-30 20:54:00,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=28, resume processing ppid=27 2023-11-30 20:54:00,797 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=28, ppid=27, state=SUCCESS; TransitRegionStateProcedure table=testScannerOnBulkLoadRefHFiles, region=550ab1f8254e7dfd3c43a65727cb6840, ASSIGN in 373 msec 2023-11-30 20:54:00,798 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:54:00,798 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testScannerOnBulkLoadRefHFiles","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377640798"}]},"ts":"1701377640798"} 2023-11-30 20:54:00,799 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testScannerOnBulkLoadRefHFiles, state=ENABLED in hbase:meta 2023-11-30 20:54:00,802 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=27, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:54:00,804 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=27, state=SUCCESS; CreateTableProcedure table=testScannerOnBulkLoadRefHFiles in 1.2280 sec 2023-11-30 20:54:01,685 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=27 2023-11-30 20:54:01,685 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testScannerOnBulkLoadRefHFiles, procId: 27 completed 2023-11-30 20:54:01,692 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:01,694 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:01,694 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-30 20:54:01,694 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:01,694 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-30 20:54:01,694 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-30 20:54:01,695 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:01,695 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:01,696 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:01,696 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:01,696 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:01,696 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:01,697 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:01,697 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:01,697 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:01,697 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:01,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:01,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:01,698 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:01,698 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:01,698 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-30 20:54:01,698 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:01,698 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-30 20:54:01,698 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:01,698 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. started... 2023-11-30 20:54:01,699 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 550ab1f8254e7dfd3c43a65727cb6840: 2023-11-30 20:54:01,699 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:54:01,699 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:01,699 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:01,699 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:01,699 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:01,699 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:54:01,699 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. started... 2023-11-30 20:54:01,699 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. started... 2023-11-30 20:54:01,700 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 92b8e7e210d6609106b2d5a4e07ee576 2/2 column families, dataSize=48 B heapSize=632 B 2023-11-30 20:54:01,700 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3361defc3633e70b83e7f7d3d89134c7: 2023-11-30 20:54:01,700 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:01,700 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:54:02,124 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130be854231dbcf44e8bd9f23f3ec830431 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231130be854231dbcf44e8bd9f23f3ec830431 2023-11-30 20:54:02,530 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=48, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/.tmp/family1/fbc69264f48a4576b46877e6ed0422bc 2023-11-30 20:54:02,536 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/.tmp/family1/fbc69264f48a4576b46877e6ed0422bc as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/fbc69264f48a4576b46877e6ed0422bc 2023-11-30 20:54:02,541 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/fbc69264f48a4576b46877e6ed0422bc, entries=1, sequenceid=5, filesize=4.9 K 2023-11-30 20:54:02,542 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~48 B/48, heapSize ~360 B/360, currentSize=0 B/0 for 92b8e7e210d6609106b2d5a4e07ee576 in 842ms, sequenceid=5, compaction requested=false 2023-11-30 20:54:02,543 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testScannerOnBulkLoadRefHFiles' 2023-11-30 20:54:02,543 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 92b8e7e210d6609106b2d5a4e07ee576: 2023-11-30 20:54:02,543 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:02,543 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:54:02,543 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:54:02,543 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,544 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-30 20:54:02,544 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-30 20:54:02,545 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,545 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:02,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,546 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:02,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:02,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:02,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:02,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-30 20:54:02,548 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4d511a76[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:02,548 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-30 20:54:02,548 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,549 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,550 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-30 20:54:02,550 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-30 20:54:02,550 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,550 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:02,550 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:02,552 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-30 20:54:02,552 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,552 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:02,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,552 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-30 20:54:02,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:02,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:02,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:02,553 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:02,554 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,555 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:02,556 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-30 20:54:02,556 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-30 20:54:02,556 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:02,556 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:02,556 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,556 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:02,558 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,558 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:02,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,558 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,558 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:02,558 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,558 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,559 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:02,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,560 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,560 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:02,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,561 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,563 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,563 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:02,563 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:02,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:02,563 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:02,563 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:02,563 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles because node does not exist (not an error) 2023-11-30 20:54:02,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-30 20:54:02,563 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:02,563 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,563 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:02,563 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,563 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:02,563 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,563 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,563 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:02,564 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,564 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:02,664 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:02,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:02,670 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:02,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testScannerOnBulkLoadRefHFiles was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:02,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,672 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testScannerOnBulkLoadRefHFiles' 2023-11-30 20:54:02,672 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:02,672 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' 2023-11-30 20:54:02,672 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testScannerOnBulkLoadRefHFiles', kicking off acquire phase on members. 2023-11-30 20:54:02,672 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,673 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,674 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:02,674 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,674 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:02,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:02,675 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:02,675 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,675 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:02,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,675 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,676 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testScannerOnBulkLoadRefHFiles is still present, removing 2023-11-30 20:54:02,676 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:02,676 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testScannerOnBulkLoadRefHFiles' with timeout 60000ms 2023-11-30 20:54:02,676 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:02,676 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testScannerOnBulkLoadRefHFiles' starting 'acquire' stage 2023-11-30 20:54:02,676 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:02,676 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. started... 2023-11-30 20:54:02,676 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 550ab1f8254e7dfd3c43a65727cb6840: 2023-11-30 20:54:02,676 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:54:02,678 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:54:02,678 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:02,678 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:02,678 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:54:02,678 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:02,678 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. started... 2023-11-30 20:54:02,678 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. started... 2023-11-30 20:54:02,678 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 92b8e7e210d6609106b2d5a4e07ee576 2/2 column families, dataSize=90 B heapSize=752 B 2023-11-30 20:54:02,679 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 3361defc3633e70b83e7f7d3d89134c7: 2023-11-30 20:54:02,679 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:54:02,679 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:54:02,691 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130a65764d4fcea4bc5b02e34d72ea888cb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231130a65764d4fcea4bc5b02e34d72ea888cb 2023-11-30 20:54:03,098 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=90, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/.tmp/family1/69e24349356f48ebb90ef04162606b74 2023-11-30 20:54:03,103 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/.tmp/family1/69e24349356f48ebb90ef04162606b74 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/69e24349356f48ebb90ef04162606b74 2023-11-30 20:54:03,109 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/69e24349356f48ebb90ef04162606b74, entries=2, sequenceid=9, filesize=5.0 K 2023-11-30 20:54:03,110 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~90 B/90, heapSize ~480 B/480, currentSize=0 B/0 for 92b8e7e210d6609106b2d5a4e07ee576 in 432ms, sequenceid=9, compaction requested=false 2023-11-30 20:54:03,110 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 92b8e7e210d6609106b2d5a4e07ee576: 2023-11-30 20:54:03,110 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:54:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:54:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally acquired 2023-11-30 20:54:03,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testScannerOnBulkLoadRefHFiles) in zk 2023-11-30 20:54:03,113 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,113 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:03,113 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,113 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testScannerOnBulkLoadRefHFiles' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:03,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testScannerOnBulkLoadRefHFiles' on coordinator 2023-11-30 20:54:03,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5851f022[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:03,115 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testScannerOnBulkLoadRefHFiles' starting 'in-barrier' execution. 2023-11-30 20:54:03,115 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,117 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,117 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testScannerOnBulkLoadRefHFiles' received 'reached' from coordinator. 2023-11-30 20:54:03,117 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testScannerOnBulkLoadRefHFiles' locally completed 2023-11-30 20:54:03,117 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testScannerOnBulkLoadRefHFiles' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:03,117 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,117 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:03,119 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,119 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testScannerOnBulkLoadRefHFiles' has notified controller of completion 2023-11-30 20:54:03,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:03,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:03,119 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:03,119 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testScannerOnBulkLoadRefHFiles' completed. 2023-11-30 20:54:03,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:03,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:03,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:03,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,121 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testScannerOnBulkLoadRefHFiles' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:03,122 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testScannerOnBulkLoadRefHFiles', counting down latch. Waiting for 0 more 2023-11-30 20:54:03,122 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testScannerOnBulkLoadRefHFiles' execution completed 2023-11-30 20:54:03,122 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:03,122 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:03,122 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,122 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testScannerOnBulkLoadRefHFilesincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:03,124 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,124 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:03,124 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,124 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:03,124 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:03,125 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,125 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,125 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:03,126 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,127 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:03,127 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,128 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,133 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,133 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,133 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:03,133 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,133 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:03,133 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:03,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testScannerOnBulkLoadRefHFiles' 2023-11-30 20:54:03,133 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:03,133 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:03,133 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:03,133 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:03,134 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,134 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,134 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,134 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:03,134 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:03,134 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testScannerOnBulkLoadRefHFiles'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:03,134 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:03,234 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:03,235 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:03,243 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testScannerOnBulkLoadRefHFiles 2023-11-30 20:54:03,245 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-30 20:54:03,246 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=34, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-30 20:54:03,247 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:03,247 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=34, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378243247 2023-11-30 20:54:03,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:54:03,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testScannerOnBulkLoadRefHFiles' and column 'family1' 2023-11-30 20:54:03,248 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-30 20:54:03,249 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x4669ddc5 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:03,254 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1054e28d, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:03,254 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231130 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-30 20:54:03,686 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113004a16b0b3d894488a296883a028f511b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c2023113004a16b0b3d894488a296883a028f511b 2023-11-30 20:54:03,687 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-30 20:54:03,703 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:54:03,705 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43514, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:54:03,712 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:54:03,714 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:34266, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:54:03,724 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231130/family1/0b7afdeac067470dbe1571b08b7a4ac2 first=Optional[k0] last=Optional[k1] 2023-11-30 20:54:03,725 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231130/family1/0b7afdeac067470dbe1571b08b7a4ac2}] 2023-11-30 20:54:03,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231130/family1/0b7afdeac067470dbe1571b08b7a4ac2 for inclusion in 92b8e7e210d6609106b2d5a4e07ee576/family1 2023-11-30 20:54:03,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=k0 last=k1 2023-11-30 20:54:03,733 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-30 20:54:03,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 92b8e7e210d6609106b2d5a4e07ee576: 2023-11-30 20:54:03,734 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231130/family1/0b7afdeac067470dbe1571b08b7a4ac2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testScannerOnBulkLoadRefHFiles__esga3n07dbce0nethpeiergtgtstfvad8drlh146e0n69p5suheb6vapifk19r5o/family1/0b7afdeac067470dbe1571b08b7a4ac2 2023-11-30 20:54:03,737 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testScannerOnBulkLoadRefHFiles__esga3n07dbce0nethpeiergtgtstfvad8drlh146e0n69p5suheb6vapifk19r5o/family1/0b7afdeac067470dbe1571b08b7a4ac2 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/0d7ef4dfc71b40a0aff97953edbb334c_SeqId_12_ 2023-11-30 20:54:03,737 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testScannerOnBulkLoadRefHFiles__esga3n07dbce0nethpeiergtgtstfvad8drlh146e0n69p5suheb6vapifk19r5o/family1/0b7afdeac067470dbe1571b08b7a4ac2 into 92b8e7e210d6609106b2d5a4e07ee576/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/0d7ef4dfc71b40a0aff97953edbb334c_SeqId_12_ - updating store file list. 2023-11-30 20:54:03,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/0d7ef4dfc71b40a0aff97953edbb334c_SeqId_12_ into 92b8e7e210d6609106b2d5a4e07ee576/family1 2023-11-30 20:54:03,741 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testScannerOnBulkLoadRefHFiles__esga3n07dbce0nethpeiergtgtstfvad8drlh146e0n69p5suheb6vapifk19r5o/family1/0b7afdeac067470dbe1571b08b7a4ac2 into 92b8e7e210d6609106b2d5a4e07ee576/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/0d7ef4dfc71b40a0aff97953edbb334c_SeqId_12_) 2023-11-30 20:54:03,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testScannerOnBulkLoadRefHFiles__esga3n07dbce0nethpeiergtgtstfvad8drlh146e0n69p5suheb6vapifk19r5o/family1/0b7afdeac067470dbe1571b08b7a4ac2 2023-11-30 20:54:03,742 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-30 20:54:03,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 15445 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-30 20:54:03,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): 92b8e7e210d6609106b2d5a4e07ee576/family1 is initiating minor compaction (all files) 2023-11-30 20:54:03,743 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@dc593b6; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:03,743 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 92b8e7e210d6609106b2d5a4e07ee576/family1 in testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:54:03,743 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/fbc69264f48a4576b46877e6ed0422bc, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/69e24349356f48ebb90ef04162606b74, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/0d7ef4dfc71b40a0aff97953edbb334c_SeqId_12_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/.tmp, totalSize=15.1 K 2023-11-30 20:54:03,744 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting fbc69264f48a4576b46877e6ed0422bc, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377641686 2023-11-30 20:54:03,744 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 69e24349356f48ebb90ef04162606b74, keycount=2, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377641686 2023-11-30 20:54:03,745 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 0d7ef4dfc71b40a0aff97953edbb334c_SeqId_12_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377641686 2023-11-30 20:54:03,745 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-30 20:54:03,746 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:03,748 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231130a65764d4fcea4bc5b02e34d72ea888cb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231130a65764d4fcea4bc5b02e34d72ea888cb 2023-11-30 20:54:03,749 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231130be854231dbcf44e8bd9f23f3ec830431 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testScannerOnBulkLoadRefHFiles/9a980ee3ec24e1d8bfa59c2e531fd315/family1/c81e728d9d4c2f636f067f89cc14862c20231130be854231dbcf44e8bd9f23f3ec830431 2023-11-30 20:54:03,749 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testScannerOnBulkLoadRefHFiles 2 expired mob files are deleted 2023-11-30 20:54:03,749 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testScannerOnBulkLoadRefHFiles/c81e728d9d4c2f636f067f89cc14862c20231130' 2023-11-30 20:54:03,750 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231130 for table='testScannerOnBulkLoadRefHFiles' and column='family1' 2023-11-30 20:54:03,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testScannerOnBulkLoadRefHFiles' column='family1' 2023-11-30 20:54:03,750 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testScannerOnBulkLoadRefHFiles', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:03,751 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=34, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE 2023-11-30 20:54:03,752 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=34, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testScannerOnBulkLoadRefHFiles.mobLock, type=EXCLUSIVE in 507 msec 2023-11-30 20:54:03,756 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 92b8e7e210d6609106b2d5a4e07ee576#family1#compaction#38 average throughput is 0.06 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:54:03,788 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testScannerOnBulkLoadRefHFiles Thread=259 (was 260), OpenFileDescriptor=636 (was 638), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=307 (was 291) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 173), AvailableMemoryMB=7652 (was 7612) - AvailableMemoryMB LEAK? - 2023-11-30 20:54:03,802 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=259, OpenFileDescriptor=636, MaxFileDescriptor=60000, SystemLoadAverage=307, ProcessCount=172, AvailableMemoryMB=7652 2023-11-30 20:54:03,805 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-30 20:54:03,806 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:03,808 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:54:03,808 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyPolicy" procId is: 35 2023-11-30 20:54:03,809 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:54:03,809 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-30 20:54:03,811 DEBUG [HFileArchiver-8] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de 2023-11-30 20:54:03,811 DEBUG [HFileArchiver-8] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de empty. 2023-11-30 20:54:03,812 DEBUG [HFileArchiver-8] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de 2023-11-30 20:54:03,812 DEBUG [PEWorker-4] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyPolicy regions 2023-11-30 20:54:03,911 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-30 20:54:04,112 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-30 20:54:04,222 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-30 20:54:04,223 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 500368a3308cef6169186b92cc3c99de, NAME => 'testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:54:04,413 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-30 20:54:04,578 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/.tmp/family1/8d07f4508e2d46bc9d231f4afab40f6c as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/8d07f4508e2d46bc9d231f4afab40f6c 2023-11-30 20:54:04,585 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 92b8e7e210d6609106b2d5a4e07ee576/family1 of 92b8e7e210d6609106b2d5a4e07ee576 into 8d07f4508e2d46bc9d231f4afab40f6c(size=5.1 K), total size for store is 5.1 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:54:04,585 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 92b8e7e210d6609106b2d5a4e07ee576: 2023-11-30 20:54:04,585 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576., storeName=family1, fileCount=3, fileSize=15.1 K (4.9 K, 5.0 K, 5.2 K), priority=2, time=1701377643743; duration=0sec 2023-11-30 20:54:04,585 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:04,620 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/fbc69264f48a4576b46877e6ed0422bc, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/69e24349356f48ebb90ef04162606b74, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/0d7ef4dfc71b40a0aff97953edbb334c_SeqId_12_] to archive 2023-11-30 20:54:04,621 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:04,623 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/fbc69264f48a4576b46877e6ed0422bc to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/fbc69264f48a4576b46877e6ed0422bc 2023-11-30 20:54:04,625 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/69e24349356f48ebb90ef04162606b74 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/69e24349356f48ebb90ef04162606b74 2023-11-30 20:54:04,626 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/0d7ef4dfc71b40a0aff97953edbb334c_SeqId_12_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/family1/0d7ef4dfc71b40a0aff97953edbb334c_SeqId_12_ 2023-11-30 20:54:04,630 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:04,630 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1604): Closing 500368a3308cef6169186b92cc3c99de, disabling compactions & flushes 2023-11-30 20:54:04,630 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:04,630 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:04,630 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. after waiting 0 ms 2023-11-30 20:54:04,630 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:04,630 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:04,630 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:04,632 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:54:04,633 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701377644633"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377644633"}]},"ts":"1701377644633"} 2023-11-30 20:54:04,634 INFO [PEWorker-4] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-30 20:54:04,635 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:54:04,635 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377644635"}]},"ts":"1701377644635"} 2023-11-30 20:54:04,636 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLING in hbase:meta 2023-11-30 20:54:04,640 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=500368a3308cef6169186b92cc3c99de, ASSIGN}] 2023-11-30 20:54:04,640 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=500368a3308cef6169186b92cc3c99de, ASSIGN 2023-11-30 20:54:04,641 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=36, ppid=35, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=500368a3308cef6169186b92cc3c99de, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:04,792 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=500368a3308cef6169186b92cc3c99de, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:04,792 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701377644792"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377644792"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377644792"}]},"ts":"1701377644792"} 2023-11-30 20:54:04,794 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=37, ppid=36, state=RUNNABLE; OpenRegionProcedure 500368a3308cef6169186b92cc3c99de, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:04,914 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-30 20:54:04,946 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:04,949 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:04,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 500368a3308cef6169186b92cc3c99de, NAME => 'testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:54:04,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyPolicy 500368a3308cef6169186b92cc3c99de 2023-11-30 20:54:04,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:04,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 500368a3308cef6169186b92cc3c99de 2023-11-30 20:54:04,950 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 500368a3308cef6169186b92cc3c99de 2023-11-30 20:54:04,951 INFO [StoreOpener-500368a3308cef6169186b92cc3c99de-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 500368a3308cef6169186b92cc3c99de 2023-11-30 20:54:04,953 DEBUG [StoreOpener-500368a3308cef6169186b92cc3c99de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1 2023-11-30 20:54:04,953 DEBUG [StoreOpener-500368a3308cef6169186b92cc3c99de-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1 2023-11-30 20:54:04,953 INFO [StoreOpener-500368a3308cef6169186b92cc3c99de-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 500368a3308cef6169186b92cc3c99de columnFamilyName family1 2023-11-30 20:54:04,955 INFO [StoreOpener-500368a3308cef6169186b92cc3c99de-1] regionserver.HStore(310): Store=500368a3308cef6169186b92cc3c99de/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:04,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de 2023-11-30 20:54:04,956 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de 2023-11-30 20:54:04,959 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 500368a3308cef6169186b92cc3c99de 2023-11-30 20:54:04,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:04,961 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 500368a3308cef6169186b92cc3c99de; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=61973373, jitterRate=-0.0765247792005539}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:54:04,961 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:04,962 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de., pid=37, masterSystemTime=1701377644946 2023-11-30 20:54:04,964 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:04,964 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:04,965 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=36 updating hbase:meta row=500368a3308cef6169186b92cc3c99de, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:04,965 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de.","families":{"info":[{"qualifier":"regioninfo","vlen":69,"tag":[],"timestamp":"1701377644965"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377644965"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377644965"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377644965"}]},"ts":"1701377644965"} 2023-11-30 20:54:04,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=37, resume processing ppid=36 2023-11-30 20:54:04,968 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=37, ppid=36, state=SUCCESS; OpenRegionProcedure 500368a3308cef6169186b92cc3c99de, server=jenkins-hbase4.apache.org,40365,1701377600631 in 172 msec 2023-11-30 20:54:04,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=36, resume processing ppid=35 2023-11-30 20:54:04,970 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=36, ppid=35, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyPolicy, region=500368a3308cef6169186b92cc3c99de, ASSIGN in 329 msec 2023-11-30 20:54:04,970 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:54:04,971 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377644970"}]},"ts":"1701377644970"} 2023-11-30 20:54:04,972 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyPolicy, state=ENABLED in hbase:meta 2023-11-30 20:54:04,975 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=35, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:54:04,977 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=35, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyPolicy in 1.1700 sec 2023-11-30 20:54:05,916 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=35 2023-11-30 20:54:05,916 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyPolicy, procId: 35 completed 2023-11-30 20:54:05,939 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:05,941 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:05,941 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:05,942 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:05,942 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:05,942 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:05,942 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:05,942 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:05,944 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:05,944 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:05,944 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:05,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:05,944 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:05,945 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:05,945 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:05,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:05,945 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:05,946 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:05,946 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:05,946 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:05,946 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:05,947 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-30 20:54:05,971 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130c0d0506e4ed8496b885aaabd8300537a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0d0506e4ed8496b885aaabd8300537a 2023-11-30 20:54:06,276 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:54:06,375 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/d6175a9ac625436d83146356b4066faf 2023-11-30 20:54:06,381 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/d6175a9ac625436d83146356b4066faf as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d6175a9ac625436d83146356b4066faf 2023-11-30 20:54:06,385 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d6175a9ac625436d83146356b4066faf, entries=1000, sequenceid=5, filesize=165.1 K 2023-11-30 20:54:06,386 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 439ms, sequenceid=5, compaction requested=false 2023-11-30 20:54:06,386 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:06,386 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:06,386 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:06,386 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:06,386 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:06,386 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,386 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:06,386 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:06,388 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,388 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:06,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:06,389 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,389 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:06,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:06,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:06,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:06,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:06,390 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4abc0ceb[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:06,390 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:06,390 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,392 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,392 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,392 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:06,392 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:06,392 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:06,392 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,392 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:06,394 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,394 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:06,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:06,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:06,394 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:06,394 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:06,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,396 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:06,397 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:06,397 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:06,397 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:06,397 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:06,397 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,397 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:06,399 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,399 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:06,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,399 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:06,399 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,399 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:06,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:06,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,401 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:06,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,402 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:06,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:06,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:06,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:06,404 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:06,404 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:06,404 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:06,404 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:54:06,404 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:06,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:06,504 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:06,505 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:06,510 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:06,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:06,511 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,511 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:06,511 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:06,511 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:06,511 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:06,512 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,512 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,514 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:06,514 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,514 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:06,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:06,514 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:06,514 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:06,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,515 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:06,515 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,515 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,515 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:54:06,515 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:06,515 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:06,515 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:06,516 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:06,516 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:06,516 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:06,516 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:06,516 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:06,516 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-30 20:54:06,929 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b0e24dd91b9547ea8eb47c7b76617e2f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151128b0e24dd91b9547ea8eb47c7b76617e2f 2023-11-30 20:54:07,336 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/2d173c7e285141e59d8216e1eb87d41b 2023-11-30 20:54:07,341 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/2d173c7e285141e59d8216e1eb87d41b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/2d173c7e285141e59d8216e1eb87d41b 2023-11-30 20:54:07,346 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/2d173c7e285141e59d8216e1eb87d41b, entries=1, sequenceid=9, filesize=5.0 K 2023-11-30 20:54:07,347 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 831ms, sequenceid=9, compaction requested=false 2023-11-30 20:54:07,347 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:07,347 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:07,347 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:07,347 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:07,347 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,347 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:07,347 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:07,349 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,350 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:07,350 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,350 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:07,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,351 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:07,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:07,351 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@53d3444a[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:07,351 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:07,351 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,353 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,353 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,353 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:07,353 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:07,353 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:07,353 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,353 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:07,354 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:07,354 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,354 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:07,355 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:07,355 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:07,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:07,357 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:07,357 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:07,357 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:07,357 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:07,357 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,357 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:07,359 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,359 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:07,359 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:07,359 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:07,360 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,361 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:07,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:07,365 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:07,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:07,365 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:07,365 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:07,365 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:07,365 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:07,466 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:07,466 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:07,471 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:07,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:07,472 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,472 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:07,472 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:07,472 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:07,472 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:07,473 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,473 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,477 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,477 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:07,477 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:07,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:07,477 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:07,477 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:07,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,478 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:07,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,478 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,479 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:54:07,479 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:07,479 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:07,479 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:07,479 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:07,479 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:07,892 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201303bb7a56190484ab3682002315c3b3e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201303bb7a56190484ab3682002315c3b3e 2023-11-30 20:54:08,298 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/5bd8f0c1718d4fcd8095d75d48034092 2023-11-30 20:54:08,303 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/5bd8f0c1718d4fcd8095d75d48034092 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/5bd8f0c1718d4fcd8095d75d48034092 2023-11-30 20:54:08,307 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/5bd8f0c1718d4fcd8095d75d48034092, entries=1, sequenceid=13, filesize=4.9 K 2023-11-30 20:54:08,308 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 829ms, sequenceid=13, compaction requested=true 2023-11-30 20:54:08,308 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:08,308 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:08,308 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:08,308 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:08,308 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,309 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:08,309 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:08,310 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,310 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:08,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:08,311 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,311 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:08,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:08,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:08,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,312 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:08,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:08,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@169466ec[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:08,312 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:08,312 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,314 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,314 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,314 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,314 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:08,314 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:08,314 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:08,315 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,315 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:08,317 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:08,317 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,317 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:08,317 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:08,317 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:08,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:08,320 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:08,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:08,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:08,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,320 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:08,322 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,322 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,322 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:08,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:08,323 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,324 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:08,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:08,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:08,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:08,328 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:08,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:08,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:08,328 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:54:08,328 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:08,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,329 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:08,329 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:08,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:08,429 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:08,430 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:08,434 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:08,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:08,436 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,436 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:08,436 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:08,436 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:08,436 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:08,436 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,436 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,438 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:08,438 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,438 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:08,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:08,439 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,439 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:08,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,439 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:08,440 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,440 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,443 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:54:08,443 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,443 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:08,443 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:08,443 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:08,443 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:08,443 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:08,443 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:08,443 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:08,444 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:08,457 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512050caa9e416efc431cb1c877d1db450f1a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050caa9e416efc431cb1c877d1db450f1a 2023-11-30 20:54:08,862 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/aeb4fdaca17446848c2943b77b40d483 2023-11-30 20:54:08,867 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/aeb4fdaca17446848c2943b77b40d483 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/aeb4fdaca17446848c2943b77b40d483 2023-11-30 20:54:08,872 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/aeb4fdaca17446848c2943b77b40d483, entries=1, sequenceid=17, filesize=4.9 K 2023-11-30 20:54:08,873 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 430ms, sequenceid=17, compaction requested=true 2023-11-30 20:54:08,873 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:08,873 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:08,873 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:08,873 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:08,873 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,873 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:08,873 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:08,875 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,875 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:08,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:08,875 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,876 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:08,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:08,877 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@411344fc[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:08,877 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:08,877 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,879 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,879 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,879 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,879 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:08,879 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:08,879 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:08,879 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,879 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:08,881 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,881 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:08,881 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:08,881 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:08,881 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:08,882 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:08,883 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:08,883 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:08,883 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:08,883 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:08,883 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,883 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:08,885 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,885 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,885 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:08,885 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:08,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:08,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:08,886 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,887 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,887 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:08,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,890 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,890 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,890 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:08,890 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:08,890 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:08,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:08,890 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:08,890 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:08,890 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:08,890 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:08,891 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,891 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,891 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,891 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:08,891 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:08,891 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:08,891 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:08,991 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:08,992 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:08,996 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:08,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:08,998 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,998 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:08,998 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:08,998 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:08,998 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:08,999 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:08,999 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,001 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:09,001 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:09,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:09,002 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,002 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:09,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,002 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,002 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:09,003 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,003 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,003 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:54:09,003 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,003 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:09,003 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:09,003 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:09,003 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:09,003 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:09,003 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:09,003 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:09,003 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:09,419 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228bc32873a5fa240ad81a2bf028b284b2d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc32873a5fa240ad81a2bf028b284b2d 2023-11-30 20:54:09,825 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/f57c533a506946b8a28bec2161610917 2023-11-30 20:54:09,831 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/f57c533a506946b8a28bec2161610917 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/f57c533a506946b8a28bec2161610917 2023-11-30 20:54:09,835 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/f57c533a506946b8a28bec2161610917, entries=1, sequenceid=21, filesize=4.9 K 2023-11-30 20:54:09,836 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 833ms, sequenceid=21, compaction requested=true 2023-11-30 20:54:09,837 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:09,837 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:09,837 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:09,839 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,839 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:09,839 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,839 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:09,839 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,840 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:09,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:09,840 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6b62d361[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:09,840 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:09,841 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,842 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,842 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,842 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,842 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:09,842 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:09,842 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:09,842 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,842 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:09,844 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,844 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:09,844 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:09,844 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:09,844 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:09,845 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,846 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:09,846 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:09,846 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:09,846 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:09,846 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:09,846 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,846 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:09,849 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,849 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:09,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,849 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:09,849 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:09,849 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,849 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:09,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,850 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,851 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:09,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,851 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,856 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,856 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:09,856 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,856 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:09,856 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:09,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:09,857 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:09,856 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,856 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:09,856 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:09,857 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,857 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,857 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,857 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,857 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:09,857 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:09,857 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:09,857 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:09,957 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:09,958 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:09,962 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:09,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:09,964 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,964 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:09,964 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:09,964 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:09,964 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:09,965 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,965 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,966 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:09,966 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,966 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:09,966 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:09,967 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,967 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:09,967 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:09,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,967 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,968 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:54:09,968 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:09,968 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:09,968 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:09,968 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:09,968 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:09,968 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:09,968 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:09,968 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:09,968 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:10,381 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015123159e9f7280cfc4a458050aa44724d5ab7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123159e9f7280cfc4a458050aa44724d5ab7 2023-11-30 20:54:10,787 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/7ba4238abd2f4111ace9b745db936893 2023-11-30 20:54:10,792 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/7ba4238abd2f4111ace9b745db936893 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7ba4238abd2f4111ace9b745db936893 2023-11-30 20:54:10,796 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7ba4238abd2f4111ace9b745db936893, entries=1, sequenceid=25, filesize=4.9 K 2023-11-30 20:54:10,797 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 829ms, sequenceid=25, compaction requested=true 2023-11-30 20:54:10,797 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:10,797 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,797 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:10,798 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:10,800 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,800 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:10,800 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:10,801 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,801 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:10,801 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:10,802 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@225a3b53[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:10,802 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:10,802 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,804 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,804 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,804 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:10,804 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:10,804 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:10,804 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,804 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:10,806 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,806 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:10,806 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:10,806 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:10,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:10,809 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:10,809 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:10,809 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:10,809 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:10,809 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,809 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:10,811 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,811 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:10,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:10,811 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:10,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:10,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:10,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,813 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,816 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:10,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:10,820 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:10,820 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,820 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:10,821 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:10,821 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:10,821 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:10,921 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:10,922 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:10,926 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:10,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:10,928 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,928 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:10,928 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:10,928 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:10,928 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:10,928 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,928 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:10,931 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:10,931 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:10,931 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:10,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:10,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,932 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,932 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:54:10,932 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:10,932 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:10,932 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:10,932 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:10,932 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:10,932 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:10,932 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:10,932 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:10,932 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:11,346 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101804baf8a67d2485ba0a344d4ee4ae6f0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101804baf8a67d2485ba0a344d4ee4ae6f0 2023-11-30 20:54:11,752 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/4aa12b9224704597a4c885d9b42c8476 2023-11-30 20:54:11,757 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/4aa12b9224704597a4c885d9b42c8476 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/4aa12b9224704597a4c885d9b42c8476 2023-11-30 20:54:11,761 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/4aa12b9224704597a4c885d9b42c8476, entries=1, sequenceid=29, filesize=4.9 K 2023-11-30 20:54:11,762 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 830ms, sequenceid=29, compaction requested=true 2023-11-30 20:54:11,762 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:11,762 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:11,762 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:11,764 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,764 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:11,764 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,764 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:11,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,765 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:11,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:11,765 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17cc8af2[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:11,765 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:11,766 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,767 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:11,767 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:11,767 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:11,767 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,767 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:11,770 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,770 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:11,770 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:11,770 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:11,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:11,772 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:11,772 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:11,773 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:11,773 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:11,773 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,773 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:11,774 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,774 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:11,774 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:11,774 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:11,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:11,775 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:11,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,776 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,776 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:11,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,777 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:11,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:11,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:11,779 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,779 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,779 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:11,779 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,779 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:11,880 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:11,881 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:11,885 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:11,886 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:11,887 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,887 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:11,887 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:11,887 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:11,887 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:11,887 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,887 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,889 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:11,889 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,889 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:11,889 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:11,889 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:11,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,890 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:11,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,890 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,890 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:54:11,890 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:11,890 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:11,890 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:11,890 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:11,891 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:11,891 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:11,891 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:11,891 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:11,891 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:12,304 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601036456d68bc5d74678b35f3d4f19d60de4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601036456d68bc5d74678b35f3d4f19d60de4 2023-11-30 20:54:12,710 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/c8f0f1631c2641e38cdb6444de8c6029 2023-11-30 20:54:12,715 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/c8f0f1631c2641e38cdb6444de8c6029 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/c8f0f1631c2641e38cdb6444de8c6029 2023-11-30 20:54:12,719 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/c8f0f1631c2641e38cdb6444de8c6029, entries=1, sequenceid=33, filesize=4.9 K 2023-11-30 20:54:12,720 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 829ms, sequenceid=33, compaction requested=true 2023-11-30 20:54:12,720 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:12,720 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:12,720 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:12,721 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:12,721 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,721 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:12,721 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:12,723 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,723 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:12,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:12,724 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:12,724 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:12,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:12,724 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:12,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:12,725 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4ca30853[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:12,725 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:12,725 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,727 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,727 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,727 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:12,727 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:12,727 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:12,727 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,727 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:12,730 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,730 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:12,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:12,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:12,731 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:12,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:12,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:12,731 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:12,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,732 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:12,733 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:12,733 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:12,733 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:12,733 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:12,733 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,733 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:12,736 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,736 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:12,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,736 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,736 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:12,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:12,736 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:12,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,738 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:12,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,740 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,740 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,740 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:12,740 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,740 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:12,740 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:12,740 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:12,740 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:12,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:12,740 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:12,740 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,741 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,741 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:12,741 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:12,747 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:12,747 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:12,847 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:12,848 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:12,852 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:12,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:12,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,854 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:12,854 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:12,854 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:12,854 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:12,855 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,855 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,859 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,859 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:12,859 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:12,859 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:12,860 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:12,860 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:12,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,860 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:12,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,860 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,861 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:54:12,861 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:12,861 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:12,861 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:12,861 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:12,861 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:12,861 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:12,861 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:12,861 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:12,861 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:12,874 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907196292046e9247738c134f57d3a37592 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20150907196292046e9247738c134f57d3a37592 2023-11-30 20:54:13,279 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/57c75f631f824b3f91f304d85bbae4ea 2023-11-30 20:54:13,285 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/57c75f631f824b3f91f304d85bbae4ea as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/57c75f631f824b3f91f304d85bbae4ea 2023-11-30 20:54:13,290 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/57c75f631f824b3f91f304d85bbae4ea, entries=1, sequenceid=37, filesize=4.9 K 2023-11-30 20:54:13,291 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 430ms, sequenceid=37, compaction requested=true 2023-11-30 20:54:13,291 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:13,291 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:13,291 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:13,291 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:13,292 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,292 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:13,292 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:13,293 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:13,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,294 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:13,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:13,294 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:13,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,295 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:13,295 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:13,296 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3127337d[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:13,296 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:13,296 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,297 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,297 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,298 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,298 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:13,298 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:13,298 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:13,298 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,298 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:13,299 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:13,299 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:13,299 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,299 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:13,300 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:13,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,301 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:13,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,302 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:13,302 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:13,302 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:13,303 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:13,303 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:13,303 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,303 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:13,304 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,305 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:13,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:13,305 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:13,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,305 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:13,305 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:13,305 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:13,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:13,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,306 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:13,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,308 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,309 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,309 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,309 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:13,309 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,309 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:13,309 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:13,309 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:54:13,309 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:13,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:13,309 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:13,309 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:13,309 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,309 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,309 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,309 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,310 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:13,310 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:13,310 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:13,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:13,410 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:13,411 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:13,415 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:13,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:13,417 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,417 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:13,417 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:13,417 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' 2023-11-30 20:54:13,417 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyPolicy', kicking off acquire phase on members. 2023-11-30 20:54:13,417 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,418 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,420 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:13,420 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,420 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:13,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:13,421 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:13,421 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,421 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:13,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,422 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,422 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyPolicy is still present, removing 2023-11-30 20:54:13,422 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:13,422 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyPolicy' with timeout 60000ms 2023-11-30 20:54:13,422 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:13,422 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyPolicy' starting 'acquire' stage 2023-11-30 20:54:13,422 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:13,422 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:13,422 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:13,422 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. started... 2023-11-30 20:54:13,422 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 500368a3308cef6169186b92cc3c99de 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:13,835 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ef3dfdd5cfcd4efa95ee377e4e552564 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151120ef3dfdd5cfcd4efa95ee377e4e552564 2023-11-30 20:54:14,241 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/bc68fa75291a46daaa624fdd32fc27a3 2023-11-30 20:54:14,247 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/bc68fa75291a46daaa624fdd32fc27a3 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/bc68fa75291a46daaa624fdd32fc27a3 2023-11-30 20:54:14,251 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/bc68fa75291a46daaa624fdd32fc27a3, entries=1, sequenceid=41, filesize=4.9 K 2023-11-30 20:54:14,252 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 500368a3308cef6169186b92cc3c99de in 830ms, sequenceid=41, compaction requested=true 2023-11-30 20:54:14,252 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:14,252 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:14,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:14,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:14,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally acquired 2023-11-30 20:54:14,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyPolicy) in zk 2023-11-30 20:54:14,255 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,255 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:14,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:14,255 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,255 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:14,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:14,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:14,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:14,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyPolicy' on coordinator 2023-11-30 20:54:14,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@42d406a9[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:14,256 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyPolicy' starting 'in-barrier' execution. 2023-11-30 20:54:14,257 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,258 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyPolicy' received 'reached' from coordinator. 2023-11-30 20:54:14,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyPolicy' locally completed 2023-11-30 20:54:14,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:14,258 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,258 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:14,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyPolicy' has notified controller of completion 2023-11-30 20:54:14,260 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:14,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyPolicy' completed. 2023-11-30 20:54:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:14,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:14,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:14,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:14,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:54:14,262 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyPolicy' execution completed 2023-11-30 20:54:14,262 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:14,262 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:14,262 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,262 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:14,265 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,265 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,265 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:14,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:14,265 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:14,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,266 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:14,266 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:14,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:14,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:14,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,269 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:14,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,271 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,271 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,272 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:14,272 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:14,272 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:14,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyPolicy' 2023-11-30 20:54:14,272 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:14,272 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:14,272 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:14,272 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,272 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,272 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,272 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyPolicy because node does not exist (not an error) 2023-11-30 20:54:14,272 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:14,272 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:14,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:14,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:14,372 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:14,373 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:14,374 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyPolicy 2023-11-30 20:54:14,376 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:54:14,377 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=38, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:54:14,378 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:14,378 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=38, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378254378 2023-11-30 20:54:14,379 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:54:14,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyPolicy' and column 'family1' 2023-11-30 20:54:14,380 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:54:14,381 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x525a4722 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:14,385 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@652d976e, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:14,386 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:14,823 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103c7b62101483f4bdeb5aebe63db1242fe to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160103c7b62101483f4bdeb5aebe63db1242fe 2023-11-30 20:54:14,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:54:14,837 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:54:14,838 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:35884, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:54:14,845 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:54:14,846 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47192, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:54:14,854 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/92aa2ac244034410b8ec04ca17a8865e first=Optional[r3] last=Optional[r6] 2023-11-30 20:54:14,855 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/92aa2ac244034410b8ec04ca17a8865e}] 2023-11-30 20:54:14,858 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/92aa2ac244034410b8ec04ca17a8865e for inclusion in 500368a3308cef6169186b92cc3c99de/family1 2023-11-30 20:54:14,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-30 20:54:14,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:54:14,861 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:14,862 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228/family1/92aa2ac244034410b8ec04ca17a8865e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fgj8laqs50qst4kr0ukk14u597rc49nul8on5j9vrt947499hflgpma815b46uqf/family1/92aa2ac244034410b8ec04ca17a8865e 2023-11-30 20:54:14,864 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fgj8laqs50qst4kr0ukk14u597rc49nul8on5j9vrt947499hflgpma815b46uqf/family1/92aa2ac244034410b8ec04ca17a8865e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7287de31c5034d3b875946aa1d73892f_SeqId_44_ 2023-11-30 20:54:14,864 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fgj8laqs50qst4kr0ukk14u597rc49nul8on5j9vrt947499hflgpma815b46uqf/family1/92aa2ac244034410b8ec04ca17a8865e into 500368a3308cef6169186b92cc3c99de/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7287de31c5034d3b875946aa1d73892f_SeqId_44_ - updating store file list. 2023-11-30 20:54:14,868 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7287de31c5034d3b875946aa1d73892f_SeqId_44_ into 500368a3308cef6169186b92cc3c99de/family1 2023-11-30 20:54:14,869 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fgj8laqs50qst4kr0ukk14u597rc49nul8on5j9vrt947499hflgpma815b46uqf/family1/92aa2ac244034410b8ec04ca17a8865e into 500368a3308cef6169186b92cc3c99de/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7287de31c5034d3b875946aa1d73892f_SeqId_44_) 2023-11-30 20:54:14,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__fgj8laqs50qst4kr0ukk14u597rc49nul8on5j9vrt947499hflgpma815b46uqf/family1/92aa2ac244034410b8ec04ca17a8865e 2023-11-30 20:54:14,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-30 20:54:14,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51214 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-30 20:54:14,872 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): 500368a3308cef6169186b92cc3c99de/family1 is initiating minor compaction 2023-11-30 20:54:14,873 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5396cefa; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:14,873 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 500368a3308cef6169186b92cc3c99de/family1 in testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:14,873 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/2d173c7e285141e59d8216e1eb87d41b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/5bd8f0c1718d4fcd8095d75d48034092, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/aeb4fdaca17446848c2943b77b40d483, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/f57c533a506946b8a28bec2161610917, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7ba4238abd2f4111ace9b745db936893, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/4aa12b9224704597a4c885d9b42c8476, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/c8f0f1631c2641e38cdb6444de8c6029, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/57c75f631f824b3f91f304d85bbae4ea, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/bc68fa75291a46daaa624fdd32fc27a3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7287de31c5034d3b875946aa1d73892f_SeqId_44_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp, totalSize=50.0 K 2023-11-30 20:54:14,873 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 2d173c7e285141e59d8216e1eb87d41b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-30 20:54:14,873 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 5bd8f0c1718d4fcd8095d75d48034092, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-30 20:54:14,873 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting aeb4fdaca17446848c2943b77b40d483, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-30 20:54:14,873 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting f57c533a506946b8a28bec2161610917, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-30 20:54:14,873 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 7ba4238abd2f4111ace9b745db936893, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-30 20:54:14,873 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 4aa12b9224704597a4c885d9b42c8476, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-30 20:54:14,873 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting c8f0f1631c2641e38cdb6444de8c6029, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-30 20:54:14,873 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 57c75f631f824b3f91f304d85bbae4ea, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-30 20:54:14,874 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting bc68fa75291a46daaa624fdd32fc27a3, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-30 20:54:14,874 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 7287de31c5034d3b875946aa1d73892f_SeqId_44_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-30 20:54:14,875 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:54:14,876 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:14,878 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc32873a5fa240ad81a2bf028b284b2d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151228bc32873a5fa240ad81a2bf028b284b2d 2023-11-30 20:54:14,879 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123159e9f7280cfc4a458050aa44724d5ab7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e2015123159e9f7280cfc4a458050aa44724d5ab7 2023-11-30 20:54:14,881 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101804baf8a67d2485ba0a344d4ee4ae6f0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20160101804baf8a67d2485ba0a344d4ee4ae6f0 2023-11-30 20:54:14,882 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601036456d68bc5d74678b35f3d4f19d60de4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201601036456d68bc5d74678b35f3d4f19d60de4 2023-11-30 20:54:14,882 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 4 expired mob files are deleted 2023-11-30 20:54:14,882 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-30 20:54:14,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:14,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:14,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:14,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:14,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:14,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:14,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:14,883 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:14,920 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 500368a3308cef6169186b92cc3c99de#family1#compaction#49 average throughput is 0.68 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:54:14,958 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:54:14,958 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x4669ddc5 to 127.0.0.1:58095 2023-11-30 20:54:14,958 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:14,958 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:54:14,958 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x584467bc to 127.0.0.1:58095 2023-11-30 20:54:14,958 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:14,959 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:54:14,959 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x66798574 to 127.0.0.1:58095 2023-11-30 20:54:14,959 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:14,959 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:54:14,959 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x42aa998d to 127.0.0.1:58095 2023-11-30 20:54:14,959 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:15,344 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/d681e8f161ce41848361c538dad32af3 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d681e8f161ce41848361c538dad32af3 2023-11-30 20:54:15,350 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 500368a3308cef6169186b92cc3c99de/family1 of 500368a3308cef6169186b92cc3c99de into d681e8f161ce41848361c538dad32af3(size=6.6 K), total size for store is 171.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:54:15,350 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:15,350 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de., storeName=family1, fileCount=10, fileSize=50.0 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.5 K), priority=2, time=1701377654872; duration=0sec 2023-11-30 20:54:15,350 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:15,420 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/2d173c7e285141e59d8216e1eb87d41b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/5bd8f0c1718d4fcd8095d75d48034092, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/aeb4fdaca17446848c2943b77b40d483, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/f57c533a506946b8a28bec2161610917, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7ba4238abd2f4111ace9b745db936893, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/4aa12b9224704597a4c885d9b42c8476, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/c8f0f1631c2641e38cdb6444de8c6029, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/57c75f631f824b3f91f304d85bbae4ea, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/bc68fa75291a46daaa624fdd32fc27a3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7287de31c5034d3b875946aa1d73892f_SeqId_44_] to archive 2023-11-30 20:54:15,421 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:15,423 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/2d173c7e285141e59d8216e1eb87d41b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/2d173c7e285141e59d8216e1eb87d41b 2023-11-30 20:54:15,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/5bd8f0c1718d4fcd8095d75d48034092 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/5bd8f0c1718d4fcd8095d75d48034092 2023-11-30 20:54:15,426 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/aeb4fdaca17446848c2943b77b40d483 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/aeb4fdaca17446848c2943b77b40d483 2023-11-30 20:54:15,428 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/f57c533a506946b8a28bec2161610917 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/f57c533a506946b8a28bec2161610917 2023-11-30 20:54:15,429 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7ba4238abd2f4111ace9b745db936893 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7ba4238abd2f4111ace9b745db936893 2023-11-30 20:54:15,431 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/4aa12b9224704597a4c885d9b42c8476 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/4aa12b9224704597a4c885d9b42c8476 2023-11-30 20:54:15,432 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/c8f0f1631c2641e38cdb6444de8c6029 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/c8f0f1631c2641e38cdb6444de8c6029 2023-11-30 20:54:15,434 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/57c75f631f824b3f91f304d85bbae4ea to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/57c75f631f824b3f91f304d85bbae4ea 2023-11-30 20:54:15,435 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/bc68fa75291a46daaa624fdd32fc27a3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/bc68fa75291a46daaa624fdd32fc27a3 2023-11-30 20:54:15,436 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7287de31c5034d3b875946aa1d73892f_SeqId_44_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/7287de31c5034d3b875946aa1d73892f_SeqId_44_ 2023-11-30 20:54:15,779 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053b27dfce289d4d478d869e53996d1563 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512053b27dfce289d4d478d869e53996d1563 2023-11-30 20:54:15,780 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:54:15,807 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/95557e1604a644b49b28299a14dd1dfd first=Optional[r00] last=Optional[r2] 2023-11-30 20:54:15,807 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/95557e1604a644b49b28299a14dd1dfd}] 2023-11-30 20:54:15,810 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/95557e1604a644b49b28299a14dd1dfd for inclusion in 500368a3308cef6169186b92cc3c99de/family1 2023-11-30 20:54:15,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-30 20:54:15,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:54:15,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:15,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130/family1/95557e1604a644b49b28299a14dd1dfd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__umncvc3usd4t45aclk9506doeki3q95g83ou8mnu6p1apji4q11rnhpfihn72cu0/family1/95557e1604a644b49b28299a14dd1dfd 2023-11-30 20:54:15,817 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__umncvc3usd4t45aclk9506doeki3q95g83ou8mnu6p1apji4q11rnhpfihn72cu0/family1/95557e1604a644b49b28299a14dd1dfd as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/a9ccfc7291b84441bad1ffb742dba044_SeqId_47_ 2023-11-30 20:54:15,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__umncvc3usd4t45aclk9506doeki3q95g83ou8mnu6p1apji4q11rnhpfihn72cu0/family1/95557e1604a644b49b28299a14dd1dfd into 500368a3308cef6169186b92cc3c99de/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/a9ccfc7291b84441bad1ffb742dba044_SeqId_47_ - updating store file list. 2023-11-30 20:54:15,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/a9ccfc7291b84441bad1ffb742dba044_SeqId_47_ into 500368a3308cef6169186b92cc3c99de/family1 2023-11-30 20:54:15,823 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__umncvc3usd4t45aclk9506doeki3q95g83ou8mnu6p1apji4q11rnhpfihn72cu0/family1/95557e1604a644b49b28299a14dd1dfd into 500368a3308cef6169186b92cc3c99de/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/a9ccfc7291b84441bad1ffb742dba044_SeqId_47_) 2023-11-30 20:54:15,823 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyPolicy__umncvc3usd4t45aclk9506doeki3q95g83ou8mnu6p1apji4q11rnhpfihn72cu0/family1/95557e1604a644b49b28299a14dd1dfd 2023-11-30 20:54:15,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-30 20:54:15,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 345120 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-30 20:54:15,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): 500368a3308cef6169186b92cc3c99de/family1 is initiating minor compaction (all files) 2023-11-30 20:54:15,825 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@16dd95e5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:15,825 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 500368a3308cef6169186b92cc3c99de/family1 in testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:54:15,825 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d6175a9ac625436d83146356b4066faf, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d681e8f161ce41848361c538dad32af3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/a9ccfc7291b84441bad1ffb742dba044_SeqId_47_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp, totalSize=337.0 K 2023-11-30 20:54:15,826 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting d6175a9ac625436d83146356b4066faf, keycount=1000, bloomtype=ROW, size=165.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824433 2023-11-30 20:54:15,826 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting d681e8f161ce41848361c538dad32af3, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224433 2023-11-30 20:54:15,827 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting a9ccfc7291b84441bad1ffb742dba044_SeqId_47_, keycount=1002, bloomtype=ROW, size=165.4 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824433 2023-11-30 20:54:15,827 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:54:15,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:15,829 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0d0506e4ed8496b885aaabd8300537a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151130c0d0506e4ed8496b885aaabd8300537a 2023-11-30 20:54:15,831 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201303bb7a56190484ab3682002315c3b3e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e20151201303bb7a56190484ab3682002315c3b3e 2023-11-30 20:54:15,832 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050caa9e416efc431cb1c877d1db450f1a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/72ba7990731d4bd518c891adecd81f43/family1/d41d8cd98f00b204e9800998ecf8427e201512050caa9e416efc431cb1c877d1db450f1a 2023-11-30 20:54:15,832 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyPolicy 3 expired mob files are deleted 2023-11-30 20:54:15,832 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyPolicy/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-30 20:54:15,833 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyPolicy' and column='family1' 2023-11-30 20:54:15,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyPolicy' column='family1' 2023-11-30 20:54:15,833 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyPolicy', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:15,833 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=38, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:54:15,835 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=38, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyPolicy.mobLock, type=EXCLUSIVE in 1.4580 sec 2023-11-30 20:54:15,842 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 500368a3308cef6169186b92cc3c99de#family1#compaction#50 average throughput is 22.09 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:54:15,931 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyPolicy Thread=261 (was 259) - Thread LEAK? -, OpenFileDescriptor=637 (was 636) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=285 (was 307), ProcessCount=172 (was 172), AvailableMemoryMB=7574 (was 7652) 2023-11-30 20:54:15,943 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=261, OpenFileDescriptor=637, MaxFileDescriptor=60000, SystemLoadAverage=285, ProcessCount=172, AvailableMemoryMB=7574 2023-11-30 20:54:15,945 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-30 20:54:15,946 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:15,948 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:54:15,948 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly" procId is: 39 2023-11-30 20:54:15,949 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:54:15,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-30 20:54:15,950 DEBUG [HFileArchiver-9] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:15,951 DEBUG [HFileArchiver-9] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b empty. 2023-11-30 20:54:15,951 DEBUG [HFileArchiver-9] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:15,951 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly regions 2023-11-30 20:54:16,050 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-30 20:54:16,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-30 20:54:16,360 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-30 20:54:16,361 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(7675): creating {ENCODED => fce206c3d63220a0b9fcc84f3f5ad56b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:54:16,552 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-30 20:54:16,767 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:16,768 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1604): Closing fce206c3d63220a0b9fcc84f3f5ad56b, disabling compactions & flushes 2023-11-30 20:54:16,768 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:16,768 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:16,768 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. after waiting 0 ms 2023-11-30 20:54:16,768 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:16,768 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:16,768 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly-pool-0] regionserver.HRegion(1558): Region close journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:16,770 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:54:16,771 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377656771"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377656771"}]},"ts":"1701377656771"} 2023-11-30 20:54:16,773 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-30 20:54:16,774 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:54:16,774 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377656774"}]},"ts":"1701377656774"} 2023-11-30 20:54:16,775 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLING in hbase:meta 2023-11-30 20:54:16,778 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, ASSIGN}] 2023-11-30 20:54:16,779 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, ASSIGN 2023-11-30 20:54:16,780 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=40, ppid=39, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:16,931 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:16,931 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377656931"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377656931"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377656931"}]},"ts":"1701377656931"} 2023-11-30 20:54:16,933 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=41, ppid=40, state=RUNNABLE; OpenRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:17,054 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-30 20:54:17,066 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/.tmp/family1/1978c2704ad445119010ce1dc57bd36b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/1978c2704ad445119010ce1dc57bd36b 2023-11-30 20:54:17,071 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 500368a3308cef6169186b92cc3c99de/family1 of 500368a3308cef6169186b92cc3c99de into 1978c2704ad445119010ce1dc57bd36b(size=166.4 K), total size for store is 166.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:54:17,071 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:54:17,071 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de., storeName=family1, fileCount=3, fileSize=337.0 K (165.1 K, 6.6 K, 165.4 K), priority=2, time=1701377655825; duration=1sec 2023-11-30 20:54:17,071 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:17,085 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:17,087 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:17,087 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fce206c3d63220a0b9fcc84f3f5ad56b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:54:17,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:17,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:17,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:17,088 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:17,089 INFO [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:17,090 DEBUG [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:17,090 DEBUG [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:17,091 INFO [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fce206c3d63220a0b9fcc84f3f5ad56b columnFamilyName family1 2023-11-30 20:54:17,092 INFO [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] regionserver.HStore(310): Store=fce206c3d63220a0b9fcc84f3f5ad56b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:17,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:17,096 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:17,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:17,098 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fce206c3d63220a0b9fcc84f3f5ad56b; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68404681, jitterRate=0.01930917799472809}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:54:17,098 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:17,099 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b., pid=41, masterSystemTime=1701377657085 2023-11-30 20:54:17,101 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:17,101 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:17,101 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=40 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:17,101 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377657101"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377657101"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377657101"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377657101"}]},"ts":"1701377657101"} 2023-11-30 20:54:17,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=41, resume processing ppid=40 2023-11-30 20:54:17,104 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=41, ppid=40, state=SUCCESS; OpenRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631 in 169 msec 2023-11-30 20:54:17,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=40, resume processing ppid=39 2023-11-30 20:54:17,106 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=40, ppid=39, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, ASSIGN in 326 msec 2023-11-30 20:54:17,106 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:54:17,106 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377657106"}]},"ts":"1701377657106"} 2023-11-30 20:54:17,107 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, state=ENABLED in hbase:meta 2023-11-30 20:54:17,112 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d6175a9ac625436d83146356b4066faf, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d681e8f161ce41848361c538dad32af3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/a9ccfc7291b84441bad1ffb742dba044_SeqId_47_] to archive 2023-11-30 20:54:17,113 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=39, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:54:17,113 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:17,114 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=39, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.1680 sec 2023-11-30 20:54:17,115 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d6175a9ac625436d83146356b4066faf to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d6175a9ac625436d83146356b4066faf 2023-11-30 20:54:17,117 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d681e8f161ce41848361c538dad32af3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/d681e8f161ce41848361c538dad32af3 2023-11-30 20:54:17,118 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/a9ccfc7291b84441bad1ffb742dba044_SeqId_47_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/family1/a9ccfc7291b84441bad1ffb742dba044_SeqId_47_ 2023-11-30 20:54:18,055 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=39 2023-11-30 20:54:18,055 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, procId: 39 completed 2023-11-30 20:54:18,082 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:18,083 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,084 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:18,084 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:18,084 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:18,084 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:18,084 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,084 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,086 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:18,086 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,086 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:18,086 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,086 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:18,086 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,086 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:18,087 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,087 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,087 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,087 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:18,087 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:18,087 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:18,087 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:18,087 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:18,087 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:18,087 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:18,088 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-30 20:54:18,112 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511303956c030e6ca4849b23d87ffaa902918 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511303956c030e6ca4849b23d87ffaa902918 2023-11-30 20:54:18,517 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/0123a72138054ff5bbcd4f892849e552 2023-11-30 20:54:18,522 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/0123a72138054ff5bbcd4f892849e552 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/0123a72138054ff5bbcd4f892849e552 2023-11-30 20:54:18,527 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/0123a72138054ff5bbcd4f892849e552, entries=1000, sequenceid=5, filesize=191.4 K 2023-11-30 20:54:18,528 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 439ms, sequenceid=5, compaction requested=false 2023-11-30 20:54:18,528 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:18,528 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:18,528 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:18,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:18,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:18,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:18,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:18,530 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,530 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:18,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:18,531 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,531 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:18,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:18,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:18,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:18,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:18,532 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@31bc9f1b[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:18,532 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:18,532 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,533 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,534 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,534 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:18,534 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:18,534 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:18,534 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,534 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:18,536 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:18,536 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:18,536 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,536 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:18,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:18,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:18,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:18,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:18,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,537 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:18,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:18,539 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:18,539 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:18,539 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:18,539 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:18,539 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,539 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:18,541 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,541 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:18,541 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:18,541 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:18,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:18,541 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:18,542 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,543 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:18,543 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,545 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,545 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:18,545 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:18,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:18,545 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:18,545 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:18,545 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-30 20:54:18,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:18,545 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:18,545 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,546 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,546 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,546 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:18,546 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,546 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:18,546 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,546 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:18,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:18,646 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:18,647 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:18,651 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:18,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:18,653 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,653 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:18,653 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:18,653 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:18,653 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:18,653 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,653 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,655 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,655 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:18,655 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:18,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:18,655 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:18,655 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:18,655 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,656 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:18,656 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,656 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,656 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-30 20:54:18,656 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:18,656 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:18,656 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:18,656 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:18,657 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:18,657 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:18,657 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:18,657 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:18,657 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-30 20:54:19,070 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128b8361f3f2e174de48315e7aaabbdaced to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b8361f3f2e174de48315e7aaabbdaced 2023-11-30 20:54:19,476 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/ff496f27a8234bea8e0d6d260135f6f3 2023-11-30 20:54:19,482 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/ff496f27a8234bea8e0d6d260135f6f3 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ff496f27a8234bea8e0d6d260135f6f3 2023-11-30 20:54:19,486 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ff496f27a8234bea8e0d6d260135f6f3, entries=1, sequenceid=9, filesize=5.0 K 2023-11-30 20:54:19,487 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 830ms, sequenceid=9, compaction requested=false 2023-11-30 20:54:19,487 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:19,487 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:19,487 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:19,488 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:19,490 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,490 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:19,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:19,491 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:19,491 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:19,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:19,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:19,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:19,492 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6589e8ef[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:19,492 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:19,492 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,494 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:19,494 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,494 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:19,494 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:19,494 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:19,496 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:19,496 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,496 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:19,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:19,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:19,496 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:19,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:19,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:19,498 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:19,498 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:19,498 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:19,498 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:19,499 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,499 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:19,500 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,500 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,500 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:19,500 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:19,501 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:19,501 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,502 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,502 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,508 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,508 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,508 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:19,508 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,508 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:19,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:19,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:19,508 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-30 20:54:19,508 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:19,508 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,508 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:19,508 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,508 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:19,508 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:19,509 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:19,508 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,509 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,509 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:19,509 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:19,609 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:19,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:19,614 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:19,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:19,615 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,615 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:19,616 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:19,616 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:19,616 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:19,616 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,616 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,618 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,618 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:19,618 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:19,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:19,618 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:19,618 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:19,618 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,619 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:19,619 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,619 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,619 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-30 20:54:19,619 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:19,619 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:19,619 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:19,619 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:19,620 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:19,620 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:19,620 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:19,620 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:19,620 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:20,032 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151201ecf1b79341544a87afed17200956e11e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ecf1b79341544a87afed17200956e11e 2023-11-30 20:54:20,438 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/c2e80fd3996a4ce6ac04414046511c47 2023-11-30 20:54:20,442 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/c2e80fd3996a4ce6ac04414046511c47 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/c2e80fd3996a4ce6ac04414046511c47 2023-11-30 20:54:20,446 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/c2e80fd3996a4ce6ac04414046511c47, entries=1, sequenceid=13, filesize=5.0 K 2023-11-30 20:54:20,447 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 827ms, sequenceid=13, compaction requested=true 2023-11-30 20:54:20,447 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:20,447 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:20,448 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:20,448 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:20,448 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,448 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:20,448 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:20,449 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,450 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:20,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:20,450 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,450 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:20,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:20,450 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:20,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,451 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:20,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:20,452 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6dbd93f8[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:20,452 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:20,452 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,453 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,453 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,453 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,453 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:20,453 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:20,453 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:20,453 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,454 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:20,456 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,456 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:20,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,456 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:20,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:20,456 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:20,456 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:20,457 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:20,458 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,459 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:20,459 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:20,459 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:20,459 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:20,459 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:20,459 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,459 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:20,461 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,461 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:20,461 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,461 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,461 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:20,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:20,462 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,462 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:20,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:20,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,462 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:20,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,463 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:20,463 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,464 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,465 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,465 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:20,465 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,465 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:20,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:20,466 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:20,465 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:20,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:20,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:20,466 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,466 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,466 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,466 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,466 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,466 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:20,466 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:20,466 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:20,466 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:20,566 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:20,581 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:20,585 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:20,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:20,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,587 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:20,587 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:20,587 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:20,587 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:20,587 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,588 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,589 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,589 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:20,589 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:20,589 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:20,589 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:20,590 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:20,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,590 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:20,590 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,590 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,591 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-30 20:54:20,591 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:20,591 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:20,591 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:20,591 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:20,591 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:20,591 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:20,591 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:20,591 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:20,591 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:21,003 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512053e29e2334cf841379eaa09a2482cbfc9 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053e29e2334cf841379eaa09a2482cbfc9 2023-11-30 20:54:21,409 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/b7c63c9be97d47828c979cb6cd34db34 2023-11-30 20:54:21,413 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/b7c63c9be97d47828c979cb6cd34db34 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b7c63c9be97d47828c979cb6cd34db34 2023-11-30 20:54:21,417 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b7c63c9be97d47828c979cb6cd34db34, entries=1, sequenceid=17, filesize=5.0 K 2023-11-30 20:54:21,418 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 827ms, sequenceid=17, compaction requested=true 2023-11-30 20:54:21,418 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:21,418 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:21,419 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:21,421 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,421 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:21,422 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,422 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:21,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:21,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:21,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f3e31a8[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:21,423 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:21,424 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,425 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,425 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:21,425 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:21,425 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:21,425 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,425 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:21,426 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:21,426 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,426 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:21,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:21,427 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:21,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:21,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:21,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:21,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:21,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,429 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:21,429 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:21,429 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:21,429 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:21,429 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:21,429 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,429 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:21,431 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,431 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,431 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:21,431 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:21,431 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,432 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:21,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:21,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:21,432 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,432 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:21,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,433 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,433 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:21,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,434 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,441 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,441 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,441 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,441 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:21,441 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,441 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:21,441 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:21,441 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:21,441 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:21,441 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:21,442 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:21,441 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,442 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,442 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,442 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:21,442 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:21,442 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:21,442 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:21,542 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:21,543 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:21,547 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:21,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:21,548 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,548 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:21,549 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:21,549 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:21,549 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:21,549 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,549 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,550 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,550 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:21,551 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:21,551 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:21,551 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,551 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:21,552 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,552 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,552 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-30 20:54:21,552 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:21,552 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:21,552 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:21,552 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:21,552 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:21,552 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:21,552 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:21,552 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:21,552 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:21,965 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151228ac49a5feebfe4496888556ad6fd01d97 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac49a5feebfe4496888556ad6fd01d97 2023-11-30 20:54:22,202 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.07692307692307693, tune throughput to 53.85 MB/second 2023-11-30 20:54:22,370 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/cb4e35d716994838846724b44c64ce10 2023-11-30 20:54:22,376 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/cb4e35d716994838846724b44c64ce10 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cb4e35d716994838846724b44c64ce10 2023-11-30 20:54:22,381 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cb4e35d716994838846724b44c64ce10, entries=1, sequenceid=21, filesize=5.0 K 2023-11-30 20:54:22,382 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 830ms, sequenceid=21, compaction requested=true 2023-11-30 20:54:22,382 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:22,382 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:22,382 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:22,382 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:22,382 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,382 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:22,382 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:22,387 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,387 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:22,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:22,388 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:22,388 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:22,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:22,388 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,389 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:22,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:22,389 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aaf3313[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:22,389 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:22,389 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,391 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,391 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,391 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:22,391 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:22,391 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:22,391 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,391 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:22,392 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:22,392 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,392 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:22,392 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:22,392 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:22,393 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,394 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,395 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:22,395 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:22,395 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:22,395 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:22,395 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:22,395 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,395 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:22,397 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,397 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,397 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:22,397 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:22,397 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,398 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,398 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,399 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,399 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,402 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:22,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:22,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:22,403 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,403 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,403 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,403 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:22,403 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:22,503 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:22,504 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:22,508 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:22,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:22,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,510 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:22,510 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:22,510 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:22,510 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:22,511 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,511 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,512 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,512 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:22,512 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:22,512 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:22,513 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:22,513 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:22,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,513 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,513 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:22,514 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,514 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,514 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-30 20:54:22,514 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:22,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:22,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:22,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:22,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:22,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:22,514 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:22,514 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:22,514 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:22,623 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:54:22,928 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512313d390ffe145145998a028ea74899b69e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512313d390ffe145145998a028ea74899b69e 2023-11-30 20:54:23,335 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/b4976bdc81ff4cde8dab945297c7e38b 2023-11-30 20:54:23,339 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/b4976bdc81ff4cde8dab945297c7e38b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b4976bdc81ff4cde8dab945297c7e38b 2023-11-30 20:54:23,343 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b4976bdc81ff4cde8dab945297c7e38b, entries=1, sequenceid=25, filesize=5.0 K 2023-11-30 20:54:23,344 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 830ms, sequenceid=25, compaction requested=true 2023-11-30 20:54:23,344 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:23,344 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:23,344 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:23,344 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:23,344 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,344 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:23,344 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:23,346 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,346 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:23,346 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:23,346 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,346 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:23,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:23,348 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@70cb7639[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:23,348 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:23,348 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,350 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,350 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,350 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,350 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:23,350 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:23,350 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:23,350 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,350 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:23,351 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:23,351 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,351 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:23,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:23,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:23,352 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:23,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:23,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:23,352 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:23,353 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,354 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:23,354 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:23,354 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:23,354 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:23,354 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:23,354 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,354 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:23,356 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,356 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,356 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:23,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:23,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:23,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,356 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:23,357 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,356 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,357 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,358 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,358 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,359 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,360 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,360 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:23,360 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,360 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:23,360 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-30 20:54:23,360 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:23,360 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:23,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:23,360 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:23,360 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,360 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:23,360 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,361 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:23,361 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:23,361 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,361 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:23,361 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:23,461 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:23,462 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:23,466 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:23,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:23,467 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,467 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:23,467 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:23,467 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:23,468 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:23,468 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,468 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,471 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,471 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:23,471 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:23,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:23,471 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:23,471 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:23,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,472 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:23,472 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,472 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,473 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-30 20:54:23,473 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:23,473 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:23,473 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:23,473 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:23,473 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:23,890 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2016010153abd59a01ee4332ad8ce357340ffe63 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010153abd59a01ee4332ad8ce357340ffe63 2023-11-30 20:54:24,296 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/1714fdc017f94cf5833703e5db77d869 2023-11-30 20:54:24,302 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/1714fdc017f94cf5833703e5db77d869 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/1714fdc017f94cf5833703e5db77d869 2023-11-30 20:54:24,306 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/1714fdc017f94cf5833703e5db77d869, entries=1, sequenceid=29, filesize=5.0 K 2023-11-30 20:54:24,307 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 834ms, sequenceid=29, compaction requested=true 2023-11-30 20:54:24,307 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:24,307 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:24,307 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:24,307 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:24,307 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,307 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:24,307 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:24,310 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,310 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:24,310 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,310 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:24,310 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,311 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:24,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:24,312 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7168098b[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:24,312 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:24,312 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,313 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,313 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,313 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,313 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:24,313 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:24,313 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:24,313 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,313 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:24,318 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:24,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:24,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:24,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:24,320 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:24,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:24,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:24,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,321 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:24,323 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,323 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,323 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:24,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:24,323 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:24,323 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:24,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:24,324 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:24,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,325 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,328 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:24,328 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:24,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:24,328 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:24,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:24,428 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:24,429 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:24,433 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:24,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:24,435 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,435 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:24,435 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:24,435 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:24,435 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:24,436 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,436 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,437 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,437 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:24,437 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:24,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:24,438 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:24,438 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:24,438 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,438 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:24,439 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,439 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,439 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-30 20:54:24,439 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:24,439 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:24,439 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:24,439 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:24,439 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:24,852 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601039320a12cb26d447f9c2a60512fc22aaa to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039320a12cb26d447f9c2a60512fc22aaa 2023-11-30 20:54:25,258 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/d33dff9a4d7c4b1bb948391f2a52d904 2023-11-30 20:54:25,263 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/d33dff9a4d7c4b1bb948391f2a52d904 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d33dff9a4d7c4b1bb948391f2a52d904 2023-11-30 20:54:25,268 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d33dff9a4d7c4b1bb948391f2a52d904, entries=1, sequenceid=33, filesize=5.0 K 2023-11-30 20:54:25,269 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 830ms, sequenceid=33, compaction requested=true 2023-11-30 20:54:25,269 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:25,269 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:25,269 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:25,269 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:25,269 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,269 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:25,269 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:25,271 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,271 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:25,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:25,271 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,271 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:25,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:25,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:25,273 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@f25d57f[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:25,273 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:25,273 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,275 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:25,275 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:25,275 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:25,275 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,275 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:25,277 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,277 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:25,277 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:25,277 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:25,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:25,278 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,279 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:25,279 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:25,279 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:25,279 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:25,279 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:25,280 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,280 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:25,281 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,281 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,281 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:25,281 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:25,281 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:25,282 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:25,282 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,282 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:25,283 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,284 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:25,284 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,285 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,286 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,286 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:25,286 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,286 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:25,287 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,286 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:25,287 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:25,287 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:25,287 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:25,287 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:25,287 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,287 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,287 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,287 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:25,287 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:25,292 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:25,292 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:25,387 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:25,388 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:25,393 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:25,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:25,394 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,394 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:25,394 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:25,394 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:25,394 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:25,395 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,395 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,399 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,400 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:25,400 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:25,400 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:25,400 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:25,400 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,401 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:25,401 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,401 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,401 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-30 20:54:25,401 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:25,401 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:25,401 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:25,402 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:25,402 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:25,402 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:25,402 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:25,402 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:25,402 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:25,815 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907ebc75fdf71e1463d8659a50792940e46 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20150907ebc75fdf71e1463d8659a50792940e46 2023-11-30 20:54:26,221 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/a230899324fa44938e101ef06bd7c1a4 2023-11-30 20:54:26,225 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/a230899324fa44938e101ef06bd7c1a4 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/a230899324fa44938e101ef06bd7c1a4 2023-11-30 20:54:26,229 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/a230899324fa44938e101ef06bd7c1a4, entries=1, sequenceid=37, filesize=5.0 K 2023-11-30 20:54:26,230 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 828ms, sequenceid=37, compaction requested=true 2023-11-30 20:54:26,230 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:26,230 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:26,230 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:26,232 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,232 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:26,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:26,232 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,232 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:26,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:26,234 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2cb14823[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:26,234 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:26,234 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,235 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:26,235 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:26,235 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,236 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:26,238 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:26,238 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:26,238 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,238 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:26,239 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,240 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,241 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:26,241 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:26,241 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:26,241 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:26,241 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:26,241 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,241 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:26,243 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,243 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:26,243 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:26,243 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:26,243 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:26,243 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:26,244 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,245 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,245 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,249 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,249 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:26,249 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,250 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:26,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:26,250 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:26,250 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,250 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:26,250 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:26,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:26,250 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,250 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,250 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:26,250 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:26,250 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,250 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:26,250 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:26,350 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:26,351 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:26,355 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:26,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:26,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,357 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:26,357 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:26,357 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' 2023-11-30 20:54:26,357 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', kicking off acquire phase on members. 2023-11-30 20:54:26,357 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,357 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,361 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,361 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:26,361 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:26,361 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:26,361 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:26,361 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:26,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,362 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:26,362 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,362 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,362 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly is still present, removing 2023-11-30 20:54:26,363 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:26,363 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' with timeout 60000ms 2023-11-30 20:54:26,363 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:26,363 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'acquire' stage 2023-11-30 20:54:26,363 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:26,363 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:26,363 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:26,363 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. started... 2023-11-30 20:54:26,363 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing fce206c3d63220a0b9fcc84f3f5ad56b 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:26,775 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120ef50849037fc43cdb71d636b117fafd0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120ef50849037fc43cdb71d636b117fafd0 2023-11-30 20:54:27,181 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/cba4dacb797148b4a6418c568fd69350 2023-11-30 20:54:27,187 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/cba4dacb797148b4a6418c568fd69350 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cba4dacb797148b4a6418c568fd69350 2023-11-30 20:54:27,191 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cba4dacb797148b4a6418c568fd69350, entries=1, sequenceid=41, filesize=5.0 K 2023-11-30 20:54:27,192 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for fce206c3d63220a0b9fcc84f3f5ad56b in 829ms, sequenceid=41, compaction requested=true 2023-11-30 20:54:27,192 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:27,192 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:27,192 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:27,192 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:27,192 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,192 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally acquired 2023-11-30 20:54:27,192 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly) in zk 2023-11-30 20:54:27,194 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,194 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:27,194 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:27,195 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,195 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:27,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:27,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:27,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,196 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:27,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' on coordinator 2023-11-30 20:54:27,196 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7e09932[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:27,196 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' starting 'in-barrier' execution. 2023-11-30 20:54:27,196 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,197 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,197 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,197 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,198 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' received 'reached' from coordinator. 2023-11-30 20:54:27,198 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' locally completed 2023-11-30 20:54:27,198 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:27,198 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,198 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:27,199 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' has notified controller of completion 2023-11-30 20:54:27,199 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,199 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:27,199 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' completed. 2023-11-30 20:54:27,199 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:27,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:27,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,200 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,201 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,202 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:27,202 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', counting down latch. Waiting for 0 more 2023-11-30 20:54:27,202 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' execution completed 2023-11-30 20:54:27,202 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:27,202 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:27,202 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,202 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeeklyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:27,204 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,204 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,204 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:27,204 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:27,205 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:27,205 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,205 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,206 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,206 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,207 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,209 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,209 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,209 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,209 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:27,209 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:27,209 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:27,209 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:27,209 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly because node does not exist (not an error) 2023-11-30 20:54:27,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' 2023-11-30 20:54:27,209 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:27,209 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:27,209 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,209 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:27,209 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,209 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,210 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:27,210 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:27,210 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:27,210 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:27,310 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:27,311 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:27,313 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:27,314 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-30 20:54:27,315 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=42, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-30 20:54:27,316 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:27,316 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=42, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378267316 2023-11-30 20:54:27,318 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:54:27,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-30 20:54:27,319 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:27,321 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x6e7d6b86 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:27,325 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@676207c0, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:27,325 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,165 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037c1f054dd64946a1ae13d6f56f7cee4f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601037c1f054dd64946a1ae13d6f56f7cee4f 2023-11-30 20:54:28,167 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:28,180 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:54:28,181 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53068, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:54:28,187 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:54:28,189 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53576, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:54:28,197 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0fc124cb878244d282072cf41788b66e first=Optional[r3] last=Optional[r6] 2023-11-30 20:54:28,197 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0fc124cb878244d282072cf41788b66e}] 2023-11-30 20:54:28,201 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0fc124cb878244d282072cf41788b66e for inclusion in fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:28,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-30 20:54:28,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:54:28,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:28,205 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228/family1/0fc124cb878244d282072cf41788b66e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ull4nb1o304662thnqpkflj5jdu3ccp3par8shtn76hi0eepd4jd6618lo68c9as/family1/0fc124cb878244d282072cf41788b66e 2023-11-30 20:54:28,207 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ull4nb1o304662thnqpkflj5jdu3ccp3par8shtn76hi0eepd4jd6618lo68c9as/family1/0fc124cb878244d282072cf41788b66e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/916fea06569b46ea8aa470c968de78c2_SeqId_44_ 2023-11-30 20:54:28,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ull4nb1o304662thnqpkflj5jdu3ccp3par8shtn76hi0eepd4jd6618lo68c9as/family1/0fc124cb878244d282072cf41788b66e into fce206c3d63220a0b9fcc84f3f5ad56b/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/916fea06569b46ea8aa470c968de78c2_SeqId_44_ - updating store file list. 2023-11-30 20:54:28,210 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/916fea06569b46ea8aa470c968de78c2_SeqId_44_ into fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:28,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ull4nb1o304662thnqpkflj5jdu3ccp3par8shtn76hi0eepd4jd6618lo68c9as/family1/0fc124cb878244d282072cf41788b66e into fce206c3d63220a0b9fcc84f3f5ad56b/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/916fea06569b46ea8aa470c968de78c2_SeqId_44_) 2023-11-30 20:54:28,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__ull4nb1o304662thnqpkflj5jdu3ccp3par8shtn76hi0eepd4jd6618lo68c9as/family1/0fc124cb878244d282072cf41788b66e 2023-11-30 20:54:28,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-30 20:54:28,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51565 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-30 20:54:28,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): fce206c3d63220a0b9fcc84f3f5ad56b/family1 is initiating minor compaction 2023-11-30 20:54:28,214 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@af55d18; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:28,214 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fce206c3d63220a0b9fcc84f3f5ad56b/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:28,214 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ff496f27a8234bea8e0d6d260135f6f3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/c2e80fd3996a4ce6ac04414046511c47, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b7c63c9be97d47828c979cb6cd34db34, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cb4e35d716994838846724b44c64ce10, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b4976bdc81ff4cde8dab945297c7e38b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/1714fdc017f94cf5833703e5db77d869, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d33dff9a4d7c4b1bb948391f2a52d904, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/a230899324fa44938e101ef06bd7c1a4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cba4dacb797148b4a6418c568fd69350, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/916fea06569b46ea8aa470c968de78c2_SeqId_44_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp, totalSize=50.4 K 2023-11-30 20:54:28,214 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting ff496f27a8234bea8e0d6d260135f6f3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-30 20:54:28,214 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting c2e80fd3996a4ce6ac04414046511c47, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-30 20:54:28,215 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting b7c63c9be97d47828c979cb6cd34db34, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-30 20:54:28,215 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting cb4e35d716994838846724b44c64ce10, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-30 20:54:28,215 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting b4976bdc81ff4cde8dab945297c7e38b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-30 20:54:28,215 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 1714fdc017f94cf5833703e5db77d869, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-30 20:54:28,215 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting d33dff9a4d7c4b1bb948391f2a52d904, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-30 20:54:28,215 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting a230899324fa44938e101ef06bd7c1a4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-30 20:54:28,215 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting cba4dacb797148b4a6418c568fd69350, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-30 20:54:28,215 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 916fea06569b46ea8aa470c968de78c2_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-30 20:54:28,217 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:28,217 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:28,219 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac49a5feebfe4496888556ad6fd01d97 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151228ac49a5feebfe4496888556ad6fd01d97 2023-11-30 20:54:28,220 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512313d390ffe145145998a028ea74899b69e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512313d390ffe145145998a028ea74899b69e 2023-11-30 20:54:28,222 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010153abd59a01ee4332ad8ce357340ffe63 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e2016010153abd59a01ee4332ad8ce357340ffe63 2023-11-30 20:54:28,223 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039320a12cb26d447f9c2a60512fc22aaa to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201601039320a12cb26d447f9c2a60512fc22aaa 2023-11-30 20:54:28,223 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 4 expired mob files are deleted 2023-11-30 20:54:28,223 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-30 20:54:28,223 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,224 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,263 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): fce206c3d63220a0b9fcc84f3f5ad56b#family1#compaction#61 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:54:28,290 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/2ffd49b53f1941658118a87e281053a4 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/2ffd49b53f1941658118a87e281053a4 2023-11-30 20:54:28,296 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in fce206c3d63220a0b9fcc84f3f5ad56b/family1 of fce206c3d63220a0b9fcc84f3f5ad56b into 2ffd49b53f1941658118a87e281053a4(size=6.8 K), total size for store is 198.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:54:28,296 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:28,296 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b., storeName=family1, fileCount=10, fileSize=50.4 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1701377668214; duration=0sec 2023-11-30 20:54:28,296 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:28,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ff496f27a8234bea8e0d6d260135f6f3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/c2e80fd3996a4ce6ac04414046511c47, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b7c63c9be97d47828c979cb6cd34db34, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cb4e35d716994838846724b44c64ce10, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b4976bdc81ff4cde8dab945297c7e38b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/1714fdc017f94cf5833703e5db77d869, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d33dff9a4d7c4b1bb948391f2a52d904, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/a230899324fa44938e101ef06bd7c1a4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cba4dacb797148b4a6418c568fd69350, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/916fea06569b46ea8aa470c968de78c2_SeqId_44_] to archive 2023-11-30 20:54:28,319 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:28,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ff496f27a8234bea8e0d6d260135f6f3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ff496f27a8234bea8e0d6d260135f6f3 2023-11-30 20:54:28,322 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/c2e80fd3996a4ce6ac04414046511c47 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/c2e80fd3996a4ce6ac04414046511c47 2023-11-30 20:54:28,323 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b7c63c9be97d47828c979cb6cd34db34 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b7c63c9be97d47828c979cb6cd34db34 2023-11-30 20:54:28,324 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cb4e35d716994838846724b44c64ce10 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cb4e35d716994838846724b44c64ce10 2023-11-30 20:54:28,325 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b4976bdc81ff4cde8dab945297c7e38b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/b4976bdc81ff4cde8dab945297c7e38b 2023-11-30 20:54:28,326 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/1714fdc017f94cf5833703e5db77d869 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/1714fdc017f94cf5833703e5db77d869 2023-11-30 20:54:28,327 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d33dff9a4d7c4b1bb948391f2a52d904 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d33dff9a4d7c4b1bb948391f2a52d904 2023-11-30 20:54:28,329 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/a230899324fa44938e101ef06bd7c1a4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/a230899324fa44938e101ef06bd7c1a4 2023-11-30 20:54:28,330 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cba4dacb797148b4a6418c568fd69350 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/cba4dacb797148b4a6418c568fd69350 2023-11-30 20:54:28,331 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/916fea06569b46ea8aa470c968de78c2_SeqId_44_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/916fea06569b46ea8aa470c968de78c2_SeqId_44_ 2023-11-30 20:54:28,691 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512051c73aaa249694e7086788d5473702cf2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512051c73aaa249694e7086788d5473702cf2 2023-11-30 20:54:28,692 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:28,717 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eda005cc3c81490b892f5786f8768b9a first=Optional[r00] last=Optional[r2] 2023-11-30 20:54:28,718 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eda005cc3c81490b892f5786f8768b9a}] 2023-11-30 20:54:28,720 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eda005cc3c81490b892f5786f8768b9a for inclusion in fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:28,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-30 20:54:28,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:54:28,723 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:28,724 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130/family1/eda005cc3c81490b892f5786f8768b9a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__op4ci6fo94e7lilmt8kkoj2upfon7rr6qbdv1r13c9vnkcr4277u0uahpjnpt30i/family1/eda005cc3c81490b892f5786f8768b9a 2023-11-30 20:54:28,726 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__op4ci6fo94e7lilmt8kkoj2upfon7rr6qbdv1r13c9vnkcr4277u0uahpjnpt30i/family1/eda005cc3c81490b892f5786f8768b9a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d84099e02e004bf597e5dfc325533a9f_SeqId_47_ 2023-11-30 20:54:28,726 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__op4ci6fo94e7lilmt8kkoj2upfon7rr6qbdv1r13c9vnkcr4277u0uahpjnpt30i/family1/eda005cc3c81490b892f5786f8768b9a into fce206c3d63220a0b9fcc84f3f5ad56b/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d84099e02e004bf597e5dfc325533a9f_SeqId_47_ - updating store file list. 2023-11-30 20:54:28,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d84099e02e004bf597e5dfc325533a9f_SeqId_47_ into fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:28,730 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__op4ci6fo94e7lilmt8kkoj2upfon7rr6qbdv1r13c9vnkcr4277u0uahpjnpt30i/family1/eda005cc3c81490b892f5786f8768b9a into fce206c3d63220a0b9fcc84f3f5ad56b/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d84099e02e004bf597e5dfc325533a9f_SeqId_47_) 2023-11-30 20:54:28,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__op4ci6fo94e7lilmt8kkoj2upfon7rr6qbdv1r13c9vnkcr4277u0uahpjnpt30i/family1/eda005cc3c81490b892f5786f8768b9a 2023-11-30 20:54:28,731 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-30 20:54:28,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 399433 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-30 20:54:28,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): fce206c3d63220a0b9fcc84f3f5ad56b/family1 is initiating minor compaction (all files) 2023-11-30 20:54:28,732 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@598ec2e5; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:28,732 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of fce206c3d63220a0b9fcc84f3f5ad56b/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:28,732 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/0123a72138054ff5bbcd4f892849e552, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/2ffd49b53f1941658118a87e281053a4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d84099e02e004bf597e5dfc325533a9f_SeqId_47_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp, totalSize=390.1 K 2023-11-30 20:54:28,733 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 0123a72138054ff5bbcd4f892849e552, keycount=1000, bloomtype=ROW, size=191.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824433 2023-11-30 20:54:28,733 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 2ffd49b53f1941658118a87e281053a4, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224433 2023-11-30 20:54:28,734 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting d84099e02e004bf597e5dfc325533a9f_SeqId_47_, keycount=1002, bloomtype=ROW, size=191.8 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824433 2023-11-30 20:54:28,734 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:28,735 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:28,736 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511303956c030e6ca4849b23d87ffaa902918 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511303956c030e6ca4849b23d87ffaa902918 2023-11-30 20:54:28,738 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ecf1b79341544a87afed17200956e11e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151201ecf1b79341544a87afed17200956e11e 2023-11-30 20:54:28,739 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053e29e2334cf841379eaa09a2482cbfc9 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201512053e29e2334cf841379eaa09a2482cbfc9 2023-11-30 20:54:28,739 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 3 expired mob files are deleted 2023-11-30 20:54:28,739 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-30 20:54:28,739 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:28,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:28,739 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:28,740 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=42, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-30 20:54:28,741 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=42, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 1.4270 sec 2023-11-30 20:54:28,749 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): fce206c3d63220a0b9fcc84f3f5ad56b#family1#compaction#62 average throughput is 25.80 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:54:28,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-30 20:54:28,818 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=43, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:29,227 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-30 20:54:29,228 DEBUG [PEWorker-2] util.FSTableDescriptors(519): Deleted hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000001 2023-11-30 20:54:29,228 INFO [PEWorker-2] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-30 20:54:29,231 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=44, ppid=43, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-30 20:54:29,233 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, REOPEN/MOVE}] 2023-11-30 20:54:29,233 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, REOPEN/MOVE 2023-11-30 20:54:29,234 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:29,234 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377669234"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377669234"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377669234"}]},"ts":"1701377669234"} 2023-11-30 20:54:29,236 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=46, ppid=45, state=RUNNABLE; CloseRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:29,387 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:29,388 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:29,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fce206c3d63220a0b9fcc84f3f5ad56b, disabling compactions & flushes 2023-11-30 20:54:29,388 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:29,967 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/.tmp/family1/546613e5b047467c939f3d708a1becb8 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/546613e5b047467c939f3d708a1becb8 2023-11-30 20:54:29,972 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in fce206c3d63220a0b9fcc84f3f5ad56b/family1 of fce206c3d63220a0b9fcc84f3f5ad56b into 546613e5b047467c939f3d708a1becb8(size=193.0 K), total size for store is 193.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:54:29,972 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:29,972 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:29,972 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b., storeName=family1, fileCount=3, fileSize=390.1 K (191.4 K, 6.8 K, 191.8 K), priority=2, time=1701377668732; duration=1sec 2023-11-30 20:54:29,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:29,972 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:29,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. after waiting 0 ms 2023-11-30 20:54:29,972 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:29,974 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/0123a72138054ff5bbcd4f892849e552, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/2ffd49b53f1941658118a87e281053a4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d84099e02e004bf597e5dfc325533a9f_SeqId_47_] to archive 2023-11-30 20:54:29,974 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:29,976 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/0123a72138054ff5bbcd4f892849e552 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/0123a72138054ff5bbcd4f892849e552 2023-11-30 20:54:29,977 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/2ffd49b53f1941658118a87e281053a4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/2ffd49b53f1941658118a87e281053a4 2023-11-30 20:54:29,978 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d84099e02e004bf597e5dfc325533a9f_SeqId_47_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/d84099e02e004bf597e5dfc325533a9f_SeqId_47_ 2023-11-30 20:54:29,983 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-30 20:54:29,983 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:29,984 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:29,984 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: fce206c3d63220a0b9fcc84f3f5ad56b to self. 2023-11-30 20:54:29,985 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:29,985 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=CLOSED 2023-11-30 20:54:29,986 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377669985"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377669985"}]},"ts":"1701377669985"} 2023-11-30 20:54:29,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=46, resume processing ppid=45 2023-11-30 20:54:29,988 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=46, ppid=45, state=SUCCESS; CloseRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631 in 750 msec 2023-11-30 20:54:29,988 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=45, ppid=44, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=true 2023-11-30 20:54:30,139 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:30,139 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377670139"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377670139"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377670139"}]},"ts":"1701377670139"} 2023-11-30 20:54:30,141 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=47, ppid=45, state=RUNNABLE; OpenRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:30,292 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:30,296 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:30,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fce206c3d63220a0b9fcc84f3f5ad56b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:54:30,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:30,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:30,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:30,296 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:30,297 INFO [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:30,298 DEBUG [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:30,298 DEBUG [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:30,299 INFO [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fce206c3d63220a0b9fcc84f3f5ad56b columnFamilyName family1 2023-11-30 20:54:30,303 DEBUG [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/546613e5b047467c939f3d708a1becb8 2023-11-30 20:54:30,304 INFO [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] regionserver.HStore(310): Store=fce206c3d63220a0b9fcc84f3f5ad56b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:30,304 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:30,306 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:30,308 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:30,309 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fce206c3d63220a0b9fcc84f3f5ad56b; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66199663, jitterRate=-0.013548150658607483}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:54:30,309 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:30,310 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b., pid=47, masterSystemTime=1701377670292 2023-11-30 20:54:30,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:30,311 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:30,312 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=45 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:30,312 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377670311"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377670311"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377670311"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377670311"}]},"ts":"1701377670311"} 2023-11-30 20:54:30,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=47, resume processing ppid=45 2023-11-30 20:54:30,314 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=47, ppid=45, state=SUCCESS; OpenRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631 in 172 msec 2023-11-30 20:54:30,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=45, resume processing ppid=44 2023-11-30 20:54:30,316 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=45, ppid=44, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, REOPEN/MOVE in 1.0810 sec 2023-11-30 20:54:30,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=44, resume processing ppid=43 2023-11-30 20:54:30,318 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=44, ppid=43, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.0860 sec 2023-11-30 20:54:30,320 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=43, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 1.5020 sec 2023-11-30 20:54:30,320 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=43 2023-11-30 20:54:30,321 INFO [Listener at localhost/34291] compactions.TestMobCompactor(278): alter status finished 2023-11-30 20:54:30,322 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:30,323 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-30 20:54:30,325 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=48, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-30 20:54:30,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:30,326 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=48, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378270326 2023-11-30 20:54:30,326 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:54:30,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-30 20:54:30,327 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:30,329 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x3393d45e to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:30,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@44b889eb, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:30,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:30,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:30,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:30,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:30,335 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:31,164 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511284983deb26af648baba929f00507f5468 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e201511284983deb26af648baba929f00507f5468 2023-11-30 20:54:31,165 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:31,178 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:54:31,179 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53074, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:54:31,186 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:54:31,187 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:54:31,196 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c0621e1209346ff847ca6a1b03a0fd6 first=Optional[r05] last=Optional[r8] 2023-11-30 20:54:31,196 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=51 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c0621e1209346ff847ca6a1b03a0fd6}] 2023-11-30 20:54:31,200 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c0621e1209346ff847ca6a1b03a0fd6 for inclusion in fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:31,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-30 20:54:31,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:54:31,203 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:31,204 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101/family1/1c0621e1209346ff847ca6a1b03a0fd6 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jt0l5bdvbga34nn6vrc3s0bp2k8th8tbpccvmc96b9fu6a58ib5pr1elvpftl8nu/family1/1c0621e1209346ff847ca6a1b03a0fd6 2023-11-30 20:54:31,206 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jt0l5bdvbga34nn6vrc3s0bp2k8th8tbpccvmc96b9fu6a58ib5pr1elvpftl8nu/family1/1c0621e1209346ff847ca6a1b03a0fd6 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ad11076bea8b49ff80c8e508be5e1bca_SeqId_53_ 2023-11-30 20:54:31,207 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jt0l5bdvbga34nn6vrc3s0bp2k8th8tbpccvmc96b9fu6a58ib5pr1elvpftl8nu/family1/1c0621e1209346ff847ca6a1b03a0fd6 into fce206c3d63220a0b9fcc84f3f5ad56b/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ad11076bea8b49ff80c8e508be5e1bca_SeqId_53_ - updating store file list. 2023-11-30 20:54:31,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ad11076bea8b49ff80c8e508be5e1bca_SeqId_53_ into fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:31,211 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jt0l5bdvbga34nn6vrc3s0bp2k8th8tbpccvmc96b9fu6a58ib5pr1elvpftl8nu/family1/1c0621e1209346ff847ca6a1b03a0fd6 into fce206c3d63220a0b9fcc84f3f5ad56b/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ad11076bea8b49ff80c8e508be5e1bca_SeqId_53_) 2023-11-30 20:54:31,211 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly__jt0l5bdvbga34nn6vrc3s0bp2k8th8tbpccvmc96b9fu6a58ib5pr1elvpftl8nu/family1/1c0621e1209346ff847ca6a1b03a0fd6 2023-11-30 20:54:31,213 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:31,214 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:31,215 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120ef50849037fc43cdb71d636b117fafd0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151120ef50849037fc43cdb71d636b117fafd0 2023-11-30 20:54:31,216 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b8361f3f2e174de48315e7aaabbdaced to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/f3267a7ec6e5c29f621bd6e805e83077/family1/d41d8cd98f00b204e9800998ecf8427e20151128b8361f3f2e174de48315e7aaabbdaced 2023-11-30 20:54:31,216 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2 expired mob files are deleted 2023-11-30 20:54:31,216 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-30 20:54:31,216 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:31,216 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:31,216 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:31,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:31,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:31,217 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=48, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-30 20:54:31,219 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=48, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 894 msec 2023-11-30 20:54:31,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-30 20:54:31,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=49, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:31,685 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-30 20:54:31,686 DEBUG [PEWorker-3] util.FSTableDescriptors(519): Deleted hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000002 2023-11-30 20:54:31,686 INFO [PEWorker-3] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/.tabledesc/.tableinfo.0000000003 2023-11-30 20:54:31,689 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=50, ppid=49, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly}] 2023-11-30 20:54:31,691 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, REOPEN/MOVE}] 2023-11-30 20:54:31,692 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, REOPEN/MOVE 2023-11-30 20:54:31,692 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:31,693 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377671692"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377671692"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377671692"}]},"ts":"1701377671692"} 2023-11-30 20:54:31,694 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=52, ppid=51, state=RUNNABLE; CloseRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:31,846 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:31,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:31,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fce206c3d63220a0b9fcc84f3f5ad56b, disabling compactions & flushes 2023-11-30 20:54:31,846 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:31,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:31,846 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. after waiting 0 ms 2023-11-30 20:54:31,847 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:31,853 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-30 20:54:31,854 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:31,854 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:31,854 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: fce206c3d63220a0b9fcc84f3f5ad56b to self. 2023-11-30 20:54:31,856 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:31,856 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=CLOSED 2023-11-30 20:54:31,856 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377671856"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377671856"}]},"ts":"1701377671856"} 2023-11-30 20:54:31,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=52, resume processing ppid=51 2023-11-30 20:54:31,859 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=52, ppid=51, state=SUCCESS; CloseRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631 in 163 msec 2023-11-30 20:54:31,859 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=51, ppid=50, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=true 2023-11-30 20:54:32,010 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:32,010 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377672010"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377672010"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377672010"}]},"ts":"1701377672010"} 2023-11-30 20:54:32,012 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=53, ppid=51, state=RUNNABLE; OpenRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:32,164 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:32,166 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:32,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => fce206c3d63220a0b9fcc84f3f5ad56b, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:54:32,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:32,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:32,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:32,167 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:32,168 INFO [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:32,169 DEBUG [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:32,169 DEBUG [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1 2023-11-30 20:54:32,169 INFO [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region fce206c3d63220a0b9fcc84f3f5ad56b columnFamilyName family1 2023-11-30 20:54:32,175 DEBUG [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/546613e5b047467c939f3d708a1becb8 2023-11-30 20:54:32,177 DEBUG [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/family1/ad11076bea8b49ff80c8e508be5e1bca_SeqId_53_ 2023-11-30 20:54:32,178 INFO [StoreOpener-fce206c3d63220a0b9fcc84f3f5ad56b-1] regionserver.HStore(310): Store=fce206c3d63220a0b9fcc84f3f5ad56b/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:32,178 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:32,179 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:32,182 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:54:32,182 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened fce206c3d63220a0b9fcc84f3f5ad56b; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=71238377, jitterRate=0.061534538865089417}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:54:32,183 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:54:32,183 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b., pid=53, masterSystemTime=1701377672164 2023-11-30 20:54:32,185 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:32,185 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:54:32,185 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=51 updating hbase:meta row=fce206c3d63220a0b9fcc84f3f5ad56b, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:32,185 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b.","families":{"info":[{"qualifier":"regioninfo","vlen":96,"tag":[],"timestamp":"1701377672185"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377672185"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377672185"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377672185"}]},"ts":"1701377672185"} 2023-11-30 20:54:32,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=53, resume processing ppid=51 2023-11-30 20:54:32,188 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=53, ppid=51, state=SUCCESS; OpenRegionProcedure fce206c3d63220a0b9fcc84f3f5ad56b, server=jenkins-hbase4.apache.org,40365,1701377600631 in 174 msec 2023-11-30 20:54:32,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=51, resume processing ppid=50 2023-11-30 20:54:32,189 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=51, ppid=50, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly, region=fce206c3d63220a0b9fcc84f3f5ad56b, REOPEN/MOVE in 497 msec 2023-11-30 20:54:32,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=50, resume processing ppid=49 2023-11-30 20:54:32,191 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=50, ppid=49, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 501 msec 2023-11-30 20:54:32,193 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=49, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly in 917 msec 2023-11-30 20:54:32,193 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=49 2023-11-30 20:54:32,195 INFO [Listener at localhost/34291] compactions.TestMobCompactor(278): alter status finished 2023-11-30 20:54:32,196 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly 2023-11-30 20:54:32,197 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-30 20:54:32,198 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=54, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-30 20:54:32,198 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:32,198 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=54, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378272198 2023-11-30 20:54:32,199 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:54:32,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column 'family1' 2023-11-30 20:54:32,200 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:32,201 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x6bf02b37 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:32,206 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6b870073, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:32,206 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:32,206 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:32,206 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:32,206 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:32,207 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:32,207 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:32,207 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:32,207 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' and column='family1' 2023-11-30 20:54:32,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly' column='family1' 2023-11-30 20:54:32,207 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:32,207 DEBUG [PEWorker-4] locking.LockProcedure(242): UNLOCKED pid=54, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE 2023-11-30 20:54:32,208 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=54, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly.mobLock, type=EXCLUSIVE in 11 msec 2023-11-30 20:54:32,259 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly Thread=248 (was 261), OpenFileDescriptor=653 (was 637) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=244 (was 285), ProcessCount=172 (was 172), AvailableMemoryMB=7569 (was 7574) 2023-11-30 20:54:32,269 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=248, OpenFileDescriptor=653, MaxFileDescriptor=60000, SystemLoadAverage=244, ProcessCount=172, AvailableMemoryMB=7569 2023-11-30 20:54:32,271 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} 2023-11-30 20:54:32,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:32,274 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:54:32,274 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily" procId is: 55 2023-11-30 20:54:32,274 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:54:32,275 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-30 20:54:32,276 DEBUG [HFileArchiver-10] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:32,276 DEBUG [HFileArchiver-10] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41 empty. 2023-11-30 20:54:32,277 DEBUG [HFileArchiver-10] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:32,277 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily regions 2023-11-30 20:54:32,376 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-30 20:54:32,577 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-30 20:54:32,690 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-30 20:54:32,691 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(7675): creating {ENCODED => dbe2ffe15100d5001cccf687e059cd41, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:54:32,878 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-30 20:54:33,097 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:33,097 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1604): Closing dbe2ffe15100d5001cccf687e059cd41, disabling compactions & flushes 2023-11-30 20:54:33,097 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:33,097 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:33,097 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. after waiting 0 ms 2023-11-30 20:54:33,097 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:33,097 INFO [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:33,097 DEBUG [RegionOpenAndInit-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily-pool-0] regionserver.HRegion(1558): Region close journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:33,101 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:54:33,102 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377673102"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377673102"}]},"ts":"1701377673102"} 2023-11-30 20:54:33,103 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-30 20:54:33,104 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:54:33,104 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377673104"}]},"ts":"1701377673104"} 2023-11-30 20:54:33,105 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLING in hbase:meta 2023-11-30 20:54:33,108 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, ASSIGN}] 2023-11-30 20:54:33,109 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, ASSIGN 2023-11-30 20:54:33,110 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=56, ppid=55, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:33,261 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:33,261 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377673261"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377673261"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377673261"}]},"ts":"1701377673261"} 2023-11-30 20:54:33,263 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=57, ppid=56, state=RUNNABLE; OpenRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:33,379 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-30 20:54:33,415 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:33,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:33,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbe2ffe15100d5001cccf687e059cd41, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:54:33,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:33,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:33,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:33,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:33,420 INFO [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:33,421 DEBUG [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:33,421 DEBUG [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:33,422 INFO [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe2ffe15100d5001cccf687e059cd41 columnFamilyName family1 2023-11-30 20:54:33,423 INFO [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] regionserver.HStore(310): Store=dbe2ffe15100d5001cccf687e059cd41/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:33,424 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:33,425 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:33,427 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:33,429 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:33,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbe2ffe15100d5001cccf687e059cd41; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62403022, jitterRate=-0.07012251019477844}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:54:33,430 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:33,430 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41., pid=57, masterSystemTime=1701377673415 2023-11-30 20:54:33,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:33,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:33,432 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=56 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:33,432 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377673432"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377673432"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377673432"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377673432"}]},"ts":"1701377673432"} 2023-11-30 20:54:33,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=57, resume processing ppid=56 2023-11-30 20:54:33,435 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=57, ppid=56, state=SUCCESS; OpenRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631 in 170 msec 2023-11-30 20:54:33,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=56, resume processing ppid=55 2023-11-30 20:54:33,436 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=56, ppid=55, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, ASSIGN in 327 msec 2023-11-30 20:54:33,437 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:54:33,437 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377673437"}]},"ts":"1701377673437"} 2023-11-30 20:54:33,438 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, state=ENABLED in hbase:meta 2023-11-30 20:54:33,441 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=55, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:54:33,442 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=55, state=SUCCESS; CreateTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1700 sec 2023-11-30 20:54:34,380 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=55 2023-11-30 20:54:34,380 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, procId: 55 completed 2023-11-30 20:54:34,400 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:34,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:34,402 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:34,402 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:34,402 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:34,402 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:34,402 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:34,402 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:34,405 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:34,405 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:34,405 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:34,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:34,405 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:34,405 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:34,405 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:34,406 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:34,406 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:34,406 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:34,406 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:34,406 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:34,406 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:34,406 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:34,410 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:34,410 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:34,410 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:34,410 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:34,411 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-30 20:54:34,655 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:34,835 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201511301e18ddc0e1bc46ad80d71bce5eee96e4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511301e18ddc0e1bc46ad80d71bce5eee96e4 2023-11-30 20:54:35,239 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/1722d460c4cb4f07b6114f6e6c201db3 2023-11-30 20:54:35,243 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/1722d460c4cb4f07b6114f6e6c201db3 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1722d460c4cb4f07b6114f6e6c201db3 2023-11-30 20:54:35,249 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1722d460c4cb4f07b6114f6e6c201db3, entries=1000, sequenceid=5, filesize=190.5 K 2023-11-30 20:54:35,250 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 839ms, sequenceid=5, compaction requested=false 2023-11-30 20:54:35,250 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:35,251 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:35,251 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:35,251 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:35,251 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,251 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:35,251 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:35,254 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,254 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:35,255 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,255 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:35,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,256 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:35,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:35,256 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3675fc14[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:35,256 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:35,257 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,258 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,258 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,258 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,259 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:35,259 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:35,259 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:35,259 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,259 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:35,262 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:35,262 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:35,262 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,262 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:35,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:35,263 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:35,265 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:35,265 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:35,265 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:35,265 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:35,265 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,265 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:35,271 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,271 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,271 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:35,272 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:35,272 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,273 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:35,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:35,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:35,276 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:35,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:35,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:35,276 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:35,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:35,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,277 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:35,277 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:35,277 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:35,277 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:35,377 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:35,378 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:35,382 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:35,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:35,383 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,383 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:35,383 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:35,383 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:35,383 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:35,384 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,384 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,386 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,386 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:35,386 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:35,386 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:35,386 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:35,386 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,386 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:35,387 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,387 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,387 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-30 20:54:35,387 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:35,387 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:35,387 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:35,387 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:35,387 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:35,387 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:35,387 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:35,387 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:35,388 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-30 20:54:35,514 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:54:35,800 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128c2356c82a37547aeb692b49d7064febd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128c2356c82a37547aeb692b49d7064febd 2023-11-30 20:54:36,206 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/7d38eebe7cc044628d657354b64e3e80 2023-11-30 20:54:36,212 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/7d38eebe7cc044628d657354b64e3e80 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/7d38eebe7cc044628d657354b64e3e80 2023-11-30 20:54:36,216 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/7d38eebe7cc044628d657354b64e3e80, entries=1, sequenceid=9, filesize=5.0 K 2023-11-30 20:54:36,217 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 829ms, sequenceid=9, compaction requested=false 2023-11-30 20:54:36,217 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:36,217 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:36,217 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:36,217 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:36,217 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,217 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:36,217 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:36,219 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,219 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:36,219 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:36,220 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,220 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:36,220 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:36,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:36,221 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@17da5988[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:36,221 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:36,221 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,222 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,223 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,223 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:36,223 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,223 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:36,223 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:36,223 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:36,224 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:36,224 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,224 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:36,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,224 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:36,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:36,224 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:36,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:36,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:36,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:36,227 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:36,227 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:36,227 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:36,227 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:36,227 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,227 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:36,229 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,229 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:36,229 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:36,229 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:36,229 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:36,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:36,230 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,231 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:36,231 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,234 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,234 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:36,234 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,234 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:36,234 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:36,234 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:36,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:36,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:36,234 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:36,234 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,235 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,235 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,235 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,235 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,235 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:36,235 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:36,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:36,235 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:36,335 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:36,336 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:36,340 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:36,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:36,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,341 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:36,341 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:36,341 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:36,341 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:36,342 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,342 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,344 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,344 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:36,344 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:36,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:36,344 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:36,344 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:36,344 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,344 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:36,345 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,345 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,345 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-30 20:54:36,345 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:36,345 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:36,345 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:36,345 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:36,345 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:36,346 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:36,346 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:36,346 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:36,346 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:36,758 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120162295bd58c3843c48e172e0069814c0e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120162295bd58c3843c48e172e0069814c0e 2023-11-30 20:54:37,163 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/ec5a4bc1efb94c98a9a35d4135dfa629 2023-11-30 20:54:37,168 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/ec5a4bc1efb94c98a9a35d4135dfa629 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/ec5a4bc1efb94c98a9a35d4135dfa629 2023-11-30 20:54:37,172 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/ec5a4bc1efb94c98a9a35d4135dfa629, entries=1, sequenceid=13, filesize=5.0 K 2023-11-30 20:54:37,173 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 827ms, sequenceid=13, compaction requested=true 2023-11-30 20:54:37,173 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:37,173 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:37,173 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:37,173 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:37,173 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,173 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:37,174 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:37,175 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,175 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:37,175 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:37,176 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,176 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:37,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:37,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:37,176 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,177 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:37,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:37,177 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@310cfb00[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:37,177 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:37,177 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,179 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,179 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,179 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,179 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:37,179 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:37,179 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:37,179 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,179 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:37,181 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,181 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:37,181 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:37,181 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:37,181 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:37,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:37,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:37,182 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,183 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,184 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:37,184 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:37,184 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:37,184 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:37,184 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:37,184 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,184 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:37,186 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,186 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:37,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:37,186 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,186 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,186 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:37,187 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:37,187 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,187 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,188 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,188 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,189 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,194 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,194 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,194 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,194 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,194 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:37,194 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:37,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:37,194 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:37,194 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,194 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:37,194 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:37,194 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:37,195 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,195 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:37,195 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:37,195 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:37,195 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:37,295 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:37,296 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:37,299 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:37,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:37,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,301 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:37,301 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:37,301 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:37,301 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:37,302 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,302 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,306 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,306 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:37,306 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:37,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:37,306 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,306 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:37,306 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,307 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:37,307 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,307 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,307 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-30 20:54:37,307 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,307 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:37,307 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:37,307 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:37,308 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:37,308 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:37,308 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:37,308 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:37,308 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:37,319 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151205cf62d687b6ae44e7806a021fe3863a60 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205cf62d687b6ae44e7806a021fe3863a60 2023-11-30 20:54:37,724 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/4a8877d6489d42fd952d1a42b3f8d828 2023-11-30 20:54:37,729 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/4a8877d6489d42fd952d1a42b3f8d828 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/4a8877d6489d42fd952d1a42b3f8d828 2023-11-30 20:54:37,733 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/4a8877d6489d42fd952d1a42b3f8d828, entries=1, sequenceid=17, filesize=5.0 K 2023-11-30 20:54:37,734 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 426ms, sequenceid=17, compaction requested=true 2023-11-30 20:54:37,734 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:37,734 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:37,734 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:37,734 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:37,734 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,734 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:37,734 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:37,736 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,736 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:37,736 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:37,737 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,737 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:37,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:37,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:37,737 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,738 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:37,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:37,738 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@32a6dd1a[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:37,738 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:37,738 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,740 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,740 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,740 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,740 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:37,740 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:37,740 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:37,740 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,740 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:37,742 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:37,742 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:37,742 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,742 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:37,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:37,742 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,743 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,744 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,745 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:37,745 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:37,745 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:37,745 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:37,745 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:37,745 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,745 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:37,747 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,747 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:37,747 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:37,747 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:37,747 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:37,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:37,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,748 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:37,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,750 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:37,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:37,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,751 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:37,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:37,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:37,751 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-30 20:54:37,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:37,751 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:37,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,752 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:37,752 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:37,752 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:37,752 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:37,852 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:37,853 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:37,856 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:37,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:37,858 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,858 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:37,858 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:37,858 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:37,858 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:37,859 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,859 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,860 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,860 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:37,860 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:37,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:37,861 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:37,861 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:37,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,861 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:37,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,862 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,862 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-30 20:54:37,862 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:37,862 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:37,862 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:37,862 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:37,862 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:38,276 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512283155a99a881b4ce5a708550126048e64 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512283155a99a881b4ce5a708550126048e64 2023-11-30 20:54:38,683 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/906bbb064bda4a72958fbfb728bc8d82 2023-11-30 20:54:38,688 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/906bbb064bda4a72958fbfb728bc8d82 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/906bbb064bda4a72958fbfb728bc8d82 2023-11-30 20:54:38,694 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/906bbb064bda4a72958fbfb728bc8d82, entries=1, sequenceid=21, filesize=5.0 K 2023-11-30 20:54:38,695 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 833ms, sequenceid=21, compaction requested=true 2023-11-30 20:54:38,695 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:38,695 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:38,695 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:38,695 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:38,695 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,695 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:38,695 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:38,698 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,698 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:38,698 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,698 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:38,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:38,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:38,700 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2baa0206[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:38,700 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:38,700 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,701 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,701 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,701 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:38,701 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:38,702 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,702 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:38,703 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:38,703 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:38,703 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,703 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:38,703 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,704 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:38,706 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:38,706 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:38,706 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:38,706 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:38,706 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,706 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:38,707 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,707 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,707 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:38,707 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:38,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:38,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:38,708 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:38,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,709 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,709 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:38,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,710 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:38,713 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-30 20:54:38,713 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:38,713 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:38,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:38,713 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:38,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:38,713 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:38,814 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:38,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:38,818 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:38,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:38,820 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,820 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:38,820 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:38,820 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:38,820 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:38,821 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,821 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,822 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,822 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:38,822 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:38,822 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:38,823 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:38,823 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:38,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,823 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:38,823 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,823 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,824 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-30 20:54:38,824 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:38,824 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:38,824 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:38,824 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:38,824 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:38,824 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:38,824 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:38,824 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:38,824 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:38,840 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231c8e600e2feec46149537052881d4845c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c8e600e2feec46149537052881d4845c 2023-11-30 20:54:39,248 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/97304a86675f40b4975442c70c1f035e 2023-11-30 20:54:39,253 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/97304a86675f40b4975442c70c1f035e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/97304a86675f40b4975442c70c1f035e 2023-11-30 20:54:39,257 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/97304a86675f40b4975442c70c1f035e, entries=1, sequenceid=25, filesize=5.0 K 2023-11-30 20:54:39,258 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 434ms, sequenceid=25, compaction requested=true 2023-11-30 20:54:39,258 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:39,258 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:39,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:39,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:39,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:39,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:39,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,260 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:39,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:39,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:39,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:39,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6e7908e2[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:39,262 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:39,262 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,264 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,265 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:39,265 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:39,265 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,265 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:39,265 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:39,266 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:39,266 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,266 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:39,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:39,266 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,267 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,268 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:39,269 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:39,269 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:39,269 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:39,269 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:39,269 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,269 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:39,271 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,271 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:39,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,271 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:39,271 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:39,271 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,271 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:39,272 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,273 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:39,273 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,274 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:39,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,275 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:39,275 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-30 20:54:39,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:39,275 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:39,275 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:39,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:39,275 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,275 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:39,276 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,276 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:39,276 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:39,276 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:39,276 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:39,376 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:39,377 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:39,380 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:39,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:39,382 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,382 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:39,382 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:39,382 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:39,382 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:39,382 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,382 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,389 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,389 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:39,389 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:39,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:39,390 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:39,390 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:39,390 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,390 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:39,391 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,391 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,391 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-30 20:54:39,391 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:39,391 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:39,391 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:39,391 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:39,391 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:39,391 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:39,391 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:39,391 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:39,391 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:39,804 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101e7f3674e55e943d3a559c6ccd4396168 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101e7f3674e55e943d3a559c6ccd4396168 2023-11-30 20:54:40,210 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/c07ba6d72c8e42b5b12136de7219c0a4 2023-11-30 20:54:40,215 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/c07ba6d72c8e42b5b12136de7219c0a4 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/c07ba6d72c8e42b5b12136de7219c0a4 2023-11-30 20:54:40,218 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/c07ba6d72c8e42b5b12136de7219c0a4, entries=1, sequenceid=29, filesize=5.0 K 2023-11-30 20:54:40,219 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 828ms, sequenceid=29, compaction requested=true 2023-11-30 20:54:40,219 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:40,219 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:40,219 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:40,219 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:40,219 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,219 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:40,219 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:40,221 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,221 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:40,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:40,222 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,222 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:40,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:40,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:40,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,223 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:40,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:40,223 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@38fb3ad6[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:40,223 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:40,223 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,224 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,225 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,225 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,225 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:40,225 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:40,225 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:40,225 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,225 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:40,226 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:40,226 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:40,226 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,227 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,228 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,229 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:40,229 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:40,229 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:40,229 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:40,229 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:40,229 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,229 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:40,232 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,232 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,232 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,232 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:40,232 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:40,233 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:40,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:40,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:40,233 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,233 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:40,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,234 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,234 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:40,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,235 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,236 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,236 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,237 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:40,237 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:40,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:40,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:40,237 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-30 20:54:40,237 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:40,237 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:40,237 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:40,237 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,237 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:40,237 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,237 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:40,237 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,237 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:40,237 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:40,237 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,337 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:40,338 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:40,343 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:40,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:40,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,344 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:40,345 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:40,345 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:40,345 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:40,345 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,345 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,346 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,346 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:40,347 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:40,347 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,347 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:40,347 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,347 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:40,348 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,348 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,348 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-30 20:54:40,348 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:40,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:40,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:40,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:40,348 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:40,348 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:40,348 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:40,349 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:40,369 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103cdcb571f75a44c82925f3d1df596b1ce to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdcb571f75a44c82925f3d1df596b1ce 2023-11-30 20:54:40,778 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/cfe58bda70a74ba6aaba217c2a1fb245 2023-11-30 20:54:40,783 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/cfe58bda70a74ba6aaba217c2a1fb245 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/cfe58bda70a74ba6aaba217c2a1fb245 2023-11-30 20:54:40,787 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/cfe58bda70a74ba6aaba217c2a1fb245, entries=1, sequenceid=33, filesize=5.0 K 2023-11-30 20:54:40,788 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 439ms, sequenceid=33, compaction requested=true 2023-11-30 20:54:40,788 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:40,788 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:40,788 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:40,788 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:40,788 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,788 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:40,788 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:40,790 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:40,790 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:40,790 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,791 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,791 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,792 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:40,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:40,792 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3c316ede[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:40,792 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:40,792 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,794 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,794 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,795 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:40,795 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:40,795 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:40,795 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,795 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:40,801 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:40,802 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:40,802 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,802 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:40,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:40,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:40,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:40,802 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:40,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:40,805 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:40,805 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:40,805 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:40,805 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:40,805 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,805 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:40,806 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,806 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:40,807 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:40,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:40,807 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:40,807 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,807 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,808 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:40,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,809 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,811 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,811 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,811 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:40,811 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,811 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:40,811 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-30 20:54:40,811 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:40,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:40,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:40,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:40,811 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:40,811 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,812 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,812 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,812 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,812 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:40,812 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:40,812 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:40,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:40,912 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:40,913 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:40,917 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:40,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:40,919 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,919 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:40,919 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:40,919 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:40,919 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:40,920 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,920 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,922 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:40,922 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,922 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:40,922 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:40,923 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:40,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,923 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:40,923 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:40,923 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,923 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,924 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-30 20:54:40,924 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:40,924 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:40,924 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:40,924 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:40,924 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:40,924 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:40,924 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:40,924 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:40,924 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:41,337 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20150907b7807926127742918b9df44ca68f875a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20150907b7807926127742918b9df44ca68f875a 2023-11-30 20:54:41,743 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/1f3dca6c8af54057aa3dd4905f32e65d 2023-11-30 20:54:41,748 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/1f3dca6c8af54057aa3dd4905f32e65d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1f3dca6c8af54057aa3dd4905f32e65d 2023-11-30 20:54:41,752 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1f3dca6c8af54057aa3dd4905f32e65d, entries=1, sequenceid=37, filesize=5.0 K 2023-11-30 20:54:41,753 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 829ms, sequenceid=37, compaction requested=true 2023-11-30 20:54:41,753 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:41,753 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:41,754 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:41,754 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:41,754 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,754 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:41,754 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:41,755 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,756 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:41,756 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,756 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:41,756 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,757 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:41,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:41,758 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@47f0e16c[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:41,758 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:41,758 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,759 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,759 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,759 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:41,759 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:41,759 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:41,760 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,760 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:41,761 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:41,761 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:41,761 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,761 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:41,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:41,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:41,764 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:41,764 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:41,764 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:41,764 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:41,764 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,764 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:41,770 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,770 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,770 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:41,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:41,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:41,770 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:41,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:41,770 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,770 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:41,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,771 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:41,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,772 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,772 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:41,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,773 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,774 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,774 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,774 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:41,774 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:41,774 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-30 20:54:41,774 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:41,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:41,774 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:41,774 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:41,775 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:41,774 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,775 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,775 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,775 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,775 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:41,775 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:41,775 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,775 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:41,775 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:41,875 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:41,876 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:41,880 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:41,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:41,882 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,882 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:41,882 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:41,882 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' 2023-11-30 20:54:41,882 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', kicking off acquire phase on members. 2023-11-30 20:54:41,883 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,883 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,884 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:41,884 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,884 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:41,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:41,885 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:41,885 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,885 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:41,885 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,885 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,886 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily is still present, removing 2023-11-30 20:54:41,886 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:41,886 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' with timeout 60000ms 2023-11-30 20:54:41,886 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:41,886 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'acquire' stage 2023-11-30 20:54:41,886 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:54:41,886 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:41,886 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:41,886 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. started... 2023-11-30 20:54:41,886 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing dbe2ffe15100d5001cccf687e059cd41 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:54:42,298 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120bd9879b69bbc4e74bddc6ebc3274f64e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bd9879b69bbc4e74bddc6ebc3274f64e 2023-11-30 20:54:42,703 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/d257c31927a249e68b4fb0f7ce2d601b 2023-11-30 20:54:42,708 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/d257c31927a249e68b4fb0f7ce2d601b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/d257c31927a249e68b4fb0f7ce2d601b 2023-11-30 20:54:42,711 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/d257c31927a249e68b4fb0f7ce2d601b, entries=1, sequenceid=41, filesize=5.0 K 2023-11-30 20:54:42,712 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for dbe2ffe15100d5001cccf687e059cd41 in 826ms, sequenceid=41, compaction requested=true 2023-11-30 20:54:42,712 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:42,712 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:42,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:54:42,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:54:42,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally acquired 2023-11-30 20:54:42,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily) in zk 2023-11-30 20:54:42,714 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,714 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,715 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:42,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:42,716 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:42,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' on coordinator 2023-11-30 20:54:42,717 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61e8cf68[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:42,717 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' starting 'in-barrier' execution. 2023-11-30 20:54:42,717 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,719 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,719 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,719 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' received 'reached' from coordinator. 2023-11-30 20:54:42,720 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' locally completed 2023-11-30 20:54:42,720 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:42,720 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,720 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:42,721 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' has notified controller of completion 2023-11-30 20:54:42,721 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,721 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:42,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,721 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' completed. 2023-11-30 20:54:42,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:42,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:42,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:42,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:42,723 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', counting down latch. Waiting for 0 more 2023-11-30 20:54:42,723 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' execution completed 2023-11-30 20:54:42,723 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:42,723 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:42,723 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,723 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDailyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:42,725 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,725 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:42,725 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,725 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,725 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:42,726 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:42,726 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,726 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:42,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,727 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,727 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,728 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,732 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:42,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' 2023-11-30 20:54:42,733 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:42,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:42,733 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily because node does not exist (not an error) 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:42,733 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,733 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:42,733 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:42,733 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:42,833 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:42,834 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:42,836 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:42,837 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-30 20:54:42,838 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=58, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-30 20:54:42,839 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:42,839 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=58, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378282839 2023-11-30 20:54:42,840 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:54:42,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-30 20:54:42,841 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:42,842 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x2e76fda4 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:42,847 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@73c68b72, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:42,847 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,279 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103823f6c916418442db9845661f5d5e2f6 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103823f6c916418442db9845661f5d5e2f6 2023-11-30 20:54:43,280 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:43,293 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:54:43,295 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53952, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:54:43,302 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:54:43,303 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59656, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:54:43,312 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/49ec2cfd14c8414e8282b30593a8feef first=Optional[r3] last=Optional[r6] 2023-11-30 20:54:43,312 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/49ec2cfd14c8414e8282b30593a8feef}] 2023-11-30 20:54:43,316 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/49ec2cfd14c8414e8282b30593a8feef for inclusion in dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:43,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r3 last=r6 2023-11-30 20:54:43,318 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:54:43,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:43,319 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228/family1/49ec2cfd14c8414e8282b30593a8feef to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eukuc9meok36dph53pcbueqf87mor38vgdtd1urneu1uu6fs3ur731f3t8fmd5qg/family1/49ec2cfd14c8414e8282b30593a8feef 2023-11-30 20:54:43,321 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eukuc9meok36dph53pcbueqf87mor38vgdtd1urneu1uu6fs3ur731f3t8fmd5qg/family1/49ec2cfd14c8414e8282b30593a8feef as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/9cd37fad35c5468ca7af172b3966c1e4_SeqId_44_ 2023-11-30 20:54:43,322 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eukuc9meok36dph53pcbueqf87mor38vgdtd1urneu1uu6fs3ur731f3t8fmd5qg/family1/49ec2cfd14c8414e8282b30593a8feef into dbe2ffe15100d5001cccf687e059cd41/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/9cd37fad35c5468ca7af172b3966c1e4_SeqId_44_ - updating store file list. 2023-11-30 20:54:43,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/9cd37fad35c5468ca7af172b3966c1e4_SeqId_44_ into dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:43,325 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eukuc9meok36dph53pcbueqf87mor38vgdtd1urneu1uu6fs3ur731f3t8fmd5qg/family1/49ec2cfd14c8414e8282b30593a8feef into dbe2ffe15100d5001cccf687e059cd41/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/9cd37fad35c5468ca7af172b3966c1e4_SeqId_44_) 2023-11-30 20:54:43,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__eukuc9meok36dph53pcbueqf87mor38vgdtd1urneu1uu6fs3ur731f3t8fmd5qg/family1/49ec2cfd14c8414e8282b30593a8feef 2023-11-30 20:54:43,326 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-30 20:54:43,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 51552 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-30 20:54:43,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): dbe2ffe15100d5001cccf687e059cd41/family1 is initiating minor compaction 2023-11-30 20:54:43,329 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@44798b51; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:43,329 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dbe2ffe15100d5001cccf687e059cd41/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:43,329 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/7d38eebe7cc044628d657354b64e3e80, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/ec5a4bc1efb94c98a9a35d4135dfa629, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/4a8877d6489d42fd952d1a42b3f8d828, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/906bbb064bda4a72958fbfb728bc8d82, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/97304a86675f40b4975442c70c1f035e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/c07ba6d72c8e42b5b12136de7219c0a4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/cfe58bda70a74ba6aaba217c2a1fb245, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1f3dca6c8af54057aa3dd4905f32e65d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/d257c31927a249e68b4fb0f7ce2d601b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/9cd37fad35c5468ca7af172b3966c1e4_SeqId_44_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp, totalSize=50.3 K 2023-11-30 20:54:43,329 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 7d38eebe7cc044628d657354b64e3e80, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-30 20:54:43,329 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting ec5a4bc1efb94c98a9a35d4135dfa629, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-30 20:54:43,329 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 4a8877d6489d42fd952d1a42b3f8d828, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-30 20:54:43,329 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 906bbb064bda4a72958fbfb728bc8d82, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-30 20:54:43,329 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 97304a86675f40b4975442c70c1f035e, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-30 20:54:43,330 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting c07ba6d72c8e42b5b12136de7219c0a4, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-30 20:54:43,330 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting cfe58bda70a74ba6aaba217c2a1fb245, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-30 20:54:43,330 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 1f3dca6c8af54057aa3dd4905f32e65d, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-30 20:54:43,330 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting d257c31927a249e68b4fb0f7ce2d601b, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-30 20:54:43,330 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 9cd37fad35c5468ca7af172b3966c1e4_SeqId_44_, keycount=4, bloomtype=ROW, size=5.6 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-30 20:54:43,331 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151228 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:43,332 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:43,333 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512283155a99a881b4ce5a708550126048e64 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512283155a99a881b4ce5a708550126048e64 2023-11-30 20:54:43,335 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c8e600e2feec46149537052881d4845c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151231c8e600e2feec46149537052881d4845c 2023-11-30 20:54:43,336 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101e7f3674e55e943d3a559c6ccd4396168 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160101e7f3674e55e943d3a559c6ccd4396168 2023-11-30 20:54:43,338 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdcb571f75a44c82925f3d1df596b1ce to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20160103cdcb571f75a44c82925f3d1df596b1ce 2023-11-30 20:54:43,338 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 4 expired mob files are deleted 2023-11-30 20:54:43,338 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151228' 2023-11-30 20:54:43,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151228 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151116 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151123 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,338 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,381 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): dbe2ffe15100d5001cccf687e059cd41#family1#compaction#73 average throughput is 0.32 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:54:43,407 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/a47744d5d54941c685c67a96c49e0705 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/a47744d5d54941c685c67a96c49e0705 2023-11-30 20:54:43,412 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in dbe2ffe15100d5001cccf687e059cd41/family1 of dbe2ffe15100d5001cccf687e059cd41 into a47744d5d54941c685c67a96c49e0705(size=6.8 K), total size for store is 197.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:54:43,413 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:43,413 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41., storeName=family1, fileCount=10, fileSize=50.3 K (5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.0 K, 5.6 K), priority=2, time=1701377683329; duration=0sec 2023-11-30 20:54:43,413 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:43,522 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/7d38eebe7cc044628d657354b64e3e80, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/ec5a4bc1efb94c98a9a35d4135dfa629, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/4a8877d6489d42fd952d1a42b3f8d828, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/906bbb064bda4a72958fbfb728bc8d82, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/97304a86675f40b4975442c70c1f035e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/c07ba6d72c8e42b5b12136de7219c0a4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/cfe58bda70a74ba6aaba217c2a1fb245, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1f3dca6c8af54057aa3dd4905f32e65d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/d257c31927a249e68b4fb0f7ce2d601b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/9cd37fad35c5468ca7af172b3966c1e4_SeqId_44_] to archive 2023-11-30 20:54:43,523 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:43,525 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/7d38eebe7cc044628d657354b64e3e80 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/7d38eebe7cc044628d657354b64e3e80 2023-11-30 20:54:43,526 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/ec5a4bc1efb94c98a9a35d4135dfa629 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/ec5a4bc1efb94c98a9a35d4135dfa629 2023-11-30 20:54:43,527 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/4a8877d6489d42fd952d1a42b3f8d828 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/4a8877d6489d42fd952d1a42b3f8d828 2023-11-30 20:54:43,529 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/906bbb064bda4a72958fbfb728bc8d82 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/906bbb064bda4a72958fbfb728bc8d82 2023-11-30 20:54:43,530 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/97304a86675f40b4975442c70c1f035e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/97304a86675f40b4975442c70c1f035e 2023-11-30 20:54:43,531 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/c07ba6d72c8e42b5b12136de7219c0a4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/c07ba6d72c8e42b5b12136de7219c0a4 2023-11-30 20:54:43,533 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/cfe58bda70a74ba6aaba217c2a1fb245 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/cfe58bda70a74ba6aaba217c2a1fb245 2023-11-30 20:54:43,534 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1f3dca6c8af54057aa3dd4905f32e65d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1f3dca6c8af54057aa3dd4905f32e65d 2023-11-30 20:54:43,535 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/d257c31927a249e68b4fb0f7ce2d601b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/d257c31927a249e68b4fb0f7ce2d601b 2023-11-30 20:54:43,536 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/9cd37fad35c5468ca7af172b3966c1e4_SeqId_44_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/9cd37fad35c5468ca7af172b3966c1e4_SeqId_44_ 2023-11-30 20:54:43,802 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512052dd347e4860344ddadc74e5a5ad30a73 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201512052dd347e4860344ddadc74e5a5ad30a73 2023-11-30 20:54:43,803 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:43,839 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6695b80b5b9c4ef69f0b8a948c737dfd first=Optional[r00] last=Optional[r2] 2023-11-30 20:54:43,840 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6695b80b5b9c4ef69f0b8a948c737dfd}] 2023-11-30 20:54:43,842 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6695b80b5b9c4ef69f0b8a948c737dfd for inclusion in dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:43,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r00 last=r2 2023-11-30 20:54:43,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:54:43,846 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:43,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130/family1/6695b80b5b9c4ef69f0b8a948c737dfd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__mulkpgiu59a4on5vvbu5jlvu95bpded605qf9gj7ahusgpj4o3rhqokvo0th74gc/family1/6695b80b5b9c4ef69f0b8a948c737dfd 2023-11-30 20:54:43,849 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__mulkpgiu59a4on5vvbu5jlvu95bpded605qf9gj7ahusgpj4o3rhqokvo0th74gc/family1/6695b80b5b9c4ef69f0b8a948c737dfd as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/18354bd1d30b4e688c16c07c8c1dcd7f_SeqId_47_ 2023-11-30 20:54:43,850 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__mulkpgiu59a4on5vvbu5jlvu95bpded605qf9gj7ahusgpj4o3rhqokvo0th74gc/family1/6695b80b5b9c4ef69f0b8a948c737dfd into dbe2ffe15100d5001cccf687e059cd41/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/18354bd1d30b4e688c16c07c8c1dcd7f_SeqId_47_ - updating store file list. 2023-11-30 20:54:43,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/18354bd1d30b4e688c16c07c8c1dcd7f_SeqId_47_ into dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:43,854 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__mulkpgiu59a4on5vvbu5jlvu95bpded605qf9gj7ahusgpj4o3rhqokvo0th74gc/family1/6695b80b5b9c4ef69f0b8a948c737dfd into dbe2ffe15100d5001cccf687e059cd41/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/18354bd1d30b4e688c16c07c8c1dcd7f_SeqId_47_) 2023-11-30 20:54:43,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__mulkpgiu59a4on5vvbu5jlvu95bpded605qf9gj7ahusgpj4o3rhqokvo0th74gc/family1/6695b80b5b9c4ef69f0b8a948c737dfd 2023-11-30 20:54:43,854 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-30 20:54:43,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 397422 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-30 20:54:43,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): dbe2ffe15100d5001cccf687e059cd41/family1 is initiating minor compaction (all files) 2023-11-30 20:54:43,855 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4f3f1b93; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:43,855 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of dbe2ffe15100d5001cccf687e059cd41/family1 in testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:43,855 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1722d460c4cb4f07b6114f6e6c201db3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/a47744d5d54941c685c67a96c49e0705, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/18354bd1d30b4e688c16c07c8c1dcd7f_SeqId_47_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp, totalSize=388.1 K 2023-11-30 20:54:43,856 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 1722d460c4cb4f07b6114f6e6c201db3, keycount=1000, bloomtype=ROW, size=190.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824433 2023-11-30 20:54:43,856 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting a47744d5d54941c685c67a96c49e0705, keycount=9, bloomtype=ROW, size=6.8 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224433 2023-11-30 20:54:43,857 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 18354bd1d30b4e688c16c07c8c1dcd7f_SeqId_47_, keycount=1002, bloomtype=ROW, size=190.9 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448878824433 2023-11-30 20:54:43,857 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151130 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:43,858 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:43,859 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511301e18ddc0e1bc46ad80d71bce5eee96e4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e201511301e18ddc0e1bc46ad80d71bce5eee96e4 2023-11-30 20:54:43,860 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120162295bd58c3843c48e172e0069814c0e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e2015120162295bd58c3843c48e172e0069814c0e 2023-11-30 20:54:43,861 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205cf62d687b6ae44e7806a021fe3863a60 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151205cf62d687b6ae44e7806a021fe3863a60 2023-11-30 20:54:43,862 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 3 expired mob files are deleted 2023-11-30 20:54:43,862 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151130' 2023-11-30 20:54:43,862 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151130 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:43,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 5 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:43,862 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:43,863 DEBUG [PEWorker-5] locking.LockProcedure(242): UNLOCKED pid=58, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-30 20:54:43,864 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=58, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 1.0270 sec 2023-11-30 20:54:43,872 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): dbe2ffe15100d5001cccf687e059cd41#family1#compaction#74 average throughput is 29.94 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:54:43,938 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'WEEKLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-30 20:54:43,939 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=59, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:44,350 DEBUG [PEWorker-4] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-30 20:54:44,351 DEBUG [PEWorker-4] util.FSTableDescriptors(519): Deleted hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000001 2023-11-30 20:54:44,351 INFO [PEWorker-4] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-30 20:54:44,353 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=60, ppid=59, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-30 20:54:44,355 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, REOPEN/MOVE}] 2023-11-30 20:54:44,355 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, REOPEN/MOVE 2023-11-30 20:54:44,356 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:44,356 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377684356"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377684356"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377684356"}]},"ts":"1701377684356"} 2023-11-30 20:54:44,358 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=62, ppid=61, state=RUNNABLE; CloseRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:44,509 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:44,510 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:44,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbe2ffe15100d5001cccf687e059cd41, disabling compactions & flushes 2023-11-30 20:54:44,510 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1858): waiting for 1 compactions to complete for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:45,102 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/.tmp/family1/f2e6c5738e4a48389c76851dfb516b37 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/f2e6c5738e4a48389c76851dfb516b37 2023-11-30 20:54:45,107 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in dbe2ffe15100d5001cccf687e059cd41/family1 of dbe2ffe15100d5001cccf687e059cd41 into f2e6c5738e4a48389c76851dfb516b37(size=192.0 K), total size for store is 192.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:54:45,107 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:45,107 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:45,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:45,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. after waiting 0 ms 2023-11-30 20:54:45,107 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:45,107 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41., storeName=family1, fileCount=3, fileSize=388.1 K (190.5 K, 6.8 K, 190.9 K), priority=2, time=1701377683855; duration=1sec 2023-11-30 20:54:45,107 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:45,111 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.-1] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1722d460c4cb4f07b6114f6e6c201db3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/a47744d5d54941c685c67a96c49e0705, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/18354bd1d30b4e688c16c07c8c1dcd7f_SeqId_47_] to archive 2023-11-30 20:54:45,112 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:45,114 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1722d460c4cb4f07b6114f6e6c201db3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/1722d460c4cb4f07b6114f6e6c201db3 2023-11-30 20:54:45,115 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/a47744d5d54941c685c67a96c49e0705 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/a47744d5d54941c685c67a96c49e0705 2023-11-30 20:54:45,116 DEBUG [StoreCloser-testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/18354bd1d30b4e688c16c07c8c1dcd7f_SeqId_47_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/18354bd1d30b4e688c16c07c8c1dcd7f_SeqId_47_ 2023-11-30 20:54:45,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-30 20:54:45,121 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:45,121 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:45,121 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: dbe2ffe15100d5001cccf687e059cd41 to self. 2023-11-30 20:54:45,123 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:45,123 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=CLOSED 2023-11-30 20:54:45,123 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377685123"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377685123"}]},"ts":"1701377685123"} 2023-11-30 20:54:45,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=62, resume processing ppid=61 2023-11-30 20:54:45,125 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=62, ppid=61, state=SUCCESS; CloseRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631 in 766 msec 2023-11-30 20:54:45,126 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=61, ppid=60, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=true 2023-11-30 20:54:45,276 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:45,276 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377685276"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377685276"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377685276"}]},"ts":"1701377685276"} 2023-11-30 20:54:45,278 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=63, ppid=61, state=RUNNABLE; OpenRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:45,430 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:45,432 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:45,432 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbe2ffe15100d5001cccf687e059cd41, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:54:45,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:45,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:45,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:45,433 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:45,434 INFO [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:45,435 DEBUG [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:45,435 DEBUG [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:45,435 INFO [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe2ffe15100d5001cccf687e059cd41 columnFamilyName family1 2023-11-30 20:54:45,442 DEBUG [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/f2e6c5738e4a48389c76851dfb516b37 2023-11-30 20:54:45,442 INFO [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] regionserver.HStore(310): Store=dbe2ffe15100d5001cccf687e059cd41/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:45,443 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:45,444 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:45,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:45,447 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbe2ffe15100d5001cccf687e059cd41; next sequenceid=51; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68205086, jitterRate=0.016334980726242065}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:54:45,447 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:45,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41., pid=63, masterSystemTime=1701377685429 2023-11-30 20:54:45,449 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:45,449 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:45,450 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=61 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=OPEN, openSeqNum=51, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:45,450 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377685450"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377685450"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377685450"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377685450"}]},"ts":"1701377685450"} 2023-11-30 20:54:45,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=63, resume processing ppid=61 2023-11-30 20:54:45,452 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=63, ppid=61, state=SUCCESS; OpenRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631 in 173 msec 2023-11-30 20:54:45,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=61, resume processing ppid=60 2023-11-30 20:54:45,453 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=61, ppid=60, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, REOPEN/MOVE in 1.0970 sec 2023-11-30 20:54:45,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=60, resume processing ppid=59 2023-11-30 20:54:45,455 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=60, ppid=59, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.1010 sec 2023-11-30 20:54:45,457 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=59, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 1.5180 sec 2023-11-30 20:54:45,457 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=59 2023-11-30 20:54:45,459 INFO [Listener at localhost/34291] compactions.TestMobCompactor(278): alter status finished 2023-11-30 20:54:45,460 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:45,461 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-30 20:54:45,462 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=64, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-30 20:54:45,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:45,463 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=64, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378285463 2023-11-30 20:54:45,463 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:54:45,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 5 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-30 20:54:45,464 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:45,465 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x19b6a417 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:45,470 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2c6ded46, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:45,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:45,470 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:45,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:45,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:45,471 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:46,296 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151128fc0494e139464dfd9a6f90d252a395c2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128fc0494e139464dfd9a6f90d252a395c2 2023-11-30 20:54:46,297 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:46,317 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:54:46,318 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53966, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:54:46,324 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:54:46,326 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59670, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:54:46,334 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fec8396042394614a07af0e6343f6656 first=Optional[r05] last=Optional[r8] 2023-11-30 20:54:46,334 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=51 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fec8396042394614a07af0e6343f6656}] 2023-11-30 20:54:46,338 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fec8396042394614a07af0e6343f6656 for inclusion in dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:46,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r05 last=r8 2023-11-30 20:54:46,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:54:46,341 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:46,342 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101/family1/fec8396042394614a07af0e6343f6656 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c6c5099vurmpktul18h93aiupodtsjuap2o5mbhmuks5mspgg550vpsc95l72t7r/family1/fec8396042394614a07af0e6343f6656 2023-11-30 20:54:46,344 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c6c5099vurmpktul18h93aiupodtsjuap2o5mbhmuks5mspgg550vpsc95l72t7r/family1/fec8396042394614a07af0e6343f6656 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/750cc0ace3af41ff9bbba7a182b9d377_SeqId_53_ 2023-11-30 20:54:46,345 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c6c5099vurmpktul18h93aiupodtsjuap2o5mbhmuks5mspgg550vpsc95l72t7r/family1/fec8396042394614a07af0e6343f6656 into dbe2ffe15100d5001cccf687e059cd41/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/750cc0ace3af41ff9bbba7a182b9d377_SeqId_53_ - updating store file list. 2023-11-30 20:54:46,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/750cc0ace3af41ff9bbba7a182b9d377_SeqId_53_ into dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:46,348 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c6c5099vurmpktul18h93aiupodtsjuap2o5mbhmuks5mspgg550vpsc95l72t7r/family1/fec8396042394614a07af0e6343f6656 into dbe2ffe15100d5001cccf687e059cd41/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/750cc0ace3af41ff9bbba7a182b9d377_SeqId_53_) 2023-11-30 20:54:46,348 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily__c6c5099vurmpktul18h93aiupodtsjuap2o5mbhmuks5mspgg550vpsc95l72t7r/family1/fec8396042394614a07af0e6343f6656 2023-11-30 20:54:46,350 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:46,350 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:46,352 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bd9879b69bbc4e74bddc6ebc3274f64e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151120bd9879b69bbc4e74bddc6ebc3274f64e 2023-11-30 20:54:46,353 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128c2356c82a37547aeb692b49d7064febd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/ab712011512d4414510a003ba5521696/family1/d41d8cd98f00b204e9800998ecf8427e20151128c2356c82a37547aeb692b49d7064febd 2023-11-30 20:54:46,353 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2 expired mob files are deleted 2023-11-30 20:54:46,353 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-30 20:54:46,353 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:46,354 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:46,354 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:46,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:46,354 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:46,354 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=64, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-30 20:54:46,355 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=64, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 894 msec 2023-11-30 20:54:46,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$12(2454): Client=jenkins//172.31.14.131 modify table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily from 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} to 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'} 2023-11-30 20:54:46,410 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=65, state=RUNNABLE:MODIFY_TABLE_PREPARE; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:46,819 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-30 20:54:46,820 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000002 2023-11-30 20:54:46,820 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/.tabledesc/.tableinfo.0000000003 2023-11-30 20:54:46,822 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=66, ppid=65, state=RUNNABLE:REOPEN_TABLE_REGIONS_GET_REGIONS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily}] 2023-11-30 20:54:46,824 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, REOPEN/MOVE}] 2023-11-30 20:54:46,825 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, REOPEN/MOVE 2023-11-30 20:54:46,825 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:46,825 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377686825"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377686825"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377686825"}]},"ts":"1701377686825"} 2023-11-30 20:54:46,827 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=68, ppid=67, state=RUNNABLE; CloseRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:46,978 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:46,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:46,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbe2ffe15100d5001cccf687e059cd41, disabling compactions & flushes 2023-11-30 20:54:46,979 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:46,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:46,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. after waiting 0 ms 2023-11-30 20:54:46,979 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:46,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-30 20:54:46,987 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:46,987 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:46,987 WARN [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(3512): Not adding moved region record: dbe2ffe15100d5001cccf687e059cd41 to self. 2023-11-30 20:54:46,989 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:46,989 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=CLOSED 2023-11-30 20:54:46,989 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377686989"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377686989"}]},"ts":"1701377686989"} 2023-11-30 20:54:46,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=68, resume processing ppid=67 2023-11-30 20:54:46,991 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=68, ppid=67, state=SUCCESS; CloseRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631 in 163 msec 2023-11-30 20:54:46,992 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=67, ppid=66, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, REOPEN/MOVE; state=CLOSED, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=true 2023-11-30 20:54:47,142 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:47,142 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377687142"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377687142"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377687142"}]},"ts":"1701377687142"} 2023-11-30 20:54:47,144 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=69, ppid=67, state=RUNNABLE; OpenRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:47,296 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:47,298 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:47,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => dbe2ffe15100d5001cccf687e059cd41, NAME => 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:54:47,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:47,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:47,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:47,299 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:47,300 INFO [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:47,301 DEBUG [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:47,301 DEBUG [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1 2023-11-30 20:54:47,301 INFO [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region dbe2ffe15100d5001cccf687e059cd41 columnFamilyName family1 2023-11-30 20:54:47,306 DEBUG [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/750cc0ace3af41ff9bbba7a182b9d377_SeqId_53_ 2023-11-30 20:54:47,309 DEBUG [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/family1/f2e6c5738e4a48389c76851dfb516b37 2023-11-30 20:54:47,310 INFO [StoreOpener-dbe2ffe15100d5001cccf687e059cd41-1] regionserver.HStore(310): Store=dbe2ffe15100d5001cccf687e059cd41/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:47,311 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:47,312 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:47,315 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:54:47,315 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened dbe2ffe15100d5001cccf687e059cd41; next sequenceid=56; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63647941, jitterRate=-0.05157177150249481}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:54:47,316 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:54:47,316 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41., pid=69, masterSystemTime=1701377687296 2023-11-30 20:54:47,319 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:47,319 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:54:47,319 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=67 updating hbase:meta row=dbe2ffe15100d5001cccf687e059cd41, regionState=OPEN, openSeqNum=56, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:47,319 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41.","families":{"info":[{"qualifier":"regioninfo","vlen":95,"tag":[],"timestamp":"1701377687319"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377687319"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377687319"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377687319"}]},"ts":"1701377687319"} 2023-11-30 20:54:47,322 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=69, resume processing ppid=67 2023-11-30 20:54:47,322 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=69, ppid=67, state=SUCCESS; OpenRegionProcedure dbe2ffe15100d5001cccf687e059cd41, server=jenkins-hbase4.apache.org,40365,1701377600631 in 177 msec 2023-11-30 20:54:47,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=67, resume processing ppid=66 2023-11-30 20:54:47,324 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=67, ppid=66, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily, region=dbe2ffe15100d5001cccf687e059cd41, REOPEN/MOVE in 498 msec 2023-11-30 20:54:47,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=66, resume processing ppid=65 2023-11-30 20:54:47,325 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=66, ppid=65, state=SUCCESS; ReopenTableRegionsProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 502 msec 2023-11-30 20:54:47,327 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=65, state=SUCCESS; ModifyTableProcedure table=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily in 917 msec 2023-11-30 20:54:47,328 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=65 2023-11-30 20:54:47,329 INFO [Listener at localhost/34291] compactions.TestMobCompactor(278): alter status finished 2023-11-30 20:54:47,329 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'DAILY'}] of the table testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily 2023-11-30 20:54:47,330 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-30 20:54:47,331 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=70, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-30 20:54:47,332 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:47,332 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=70, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378287332 2023-11-30 20:54:47,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:54:47,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 4 selected files, and 0 irrelevant files table 'testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column 'family1' 2023-11-30 20:54:47,333 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:47,335 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x3fabd723 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:47,339 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@23537aff, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:47,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:47,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151128 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:47,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:47,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151205 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:47,339 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:47,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160103 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:47,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:47,340 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150907 for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' and column='family1' 2023-11-30 20:54:47,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily' column='family1' 2023-11-30 20:54:47,340 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:47,340 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=70, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE 2023-11-30 20:54:47,341 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=70, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily.mobLock, type=EXCLUSIVE in 10 msec 2023-11-30 20:54:47,390 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily Thread=256 (was 248) - Thread LEAK? -, OpenFileDescriptor=680 (was 653) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=254 (was 244) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=7544 (was 7569) 2023-11-30 20:54:47,401 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=256, OpenFileDescriptor=680, MaxFileDescriptor=60000, SystemLoadAverage=254, ProcessCount=172, AvailableMemoryMB=7544 2023-11-30 20:54:47,404 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-30 20:54:47,405 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testGetAfterCompaction 2023-11-30 20:54:47,407 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:54:47,407 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testGetAfterCompaction" procId is: 71 2023-11-30 20:54:47,407 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:54:47,408 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-30 20:54:47,409 DEBUG [HFileArchiver-11] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:47,409 DEBUG [HFileArchiver-11] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f empty. 2023-11-30 20:54:47,410 DEBUG [HFileArchiver-11] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:47,410 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-30 20:54:47,509 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-30 20:54:47,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-30 20:54:47,817 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/.tabledesc/.tableinfo.0000000001 2023-11-30 20:54:47,818 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 620b5e5076846f009c3d67c4b1c0583f, NAME => 'testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testGetAfterCompaction', {TABLE_ATTRIBUTES => {coprocessor$1 => '|org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro|1073741823|'}}, {NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:54:48,011 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-30 20:54:48,224 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:48,224 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1604): Closing 620b5e5076846f009c3d67c4b1c0583f, disabling compactions & flushes 2023-11-30 20:54:48,224 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:48,224 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:48,224 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. after waiting 0 ms 2023-11-30 20:54:48,224 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:48,224 INFO [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:48,224 DEBUG [RegionOpenAndInit-testGetAfterCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 620b5e5076846f009c3d67c4b1c0583f: 2023-11-30 20:54:48,226 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:54:48,227 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701377688227"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377688227"}]},"ts":"1701377688227"} 2023-11-30 20:54:48,229 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-30 20:54:48,229 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:54:48,229 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377688229"}]},"ts":"1701377688229"} 2023-11-30 20:54:48,230 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLING in hbase:meta 2023-11-30 20:54:48,233 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=620b5e5076846f009c3d67c4b1c0583f, ASSIGN}] 2023-11-30 20:54:48,234 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testGetAfterCompaction, region=620b5e5076846f009c3d67c4b1c0583f, ASSIGN 2023-11-30 20:54:48,234 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=72, ppid=71, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testGetAfterCompaction, region=620b5e5076846f009c3d67c4b1c0583f, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:48,385 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=620b5e5076846f009c3d67c4b1c0583f, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:48,386 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701377688385"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377688385"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377688385"}]},"ts":"1701377688385"} 2023-11-30 20:54:48,387 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=73, ppid=72, state=RUNNABLE; OpenRegionProcedure 620b5e5076846f009c3d67c4b1c0583f, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:48,512 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-30 20:54:48,539 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:48,542 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:48,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 620b5e5076846f009c3d67c4b1c0583f, NAME => 'testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:54:48,542 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(215): Loading coprocessor class org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro with path null and priority 1073741823 2023-11-30 20:54:48,544 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.RegionCoprocessorHost(393): Loaded coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro from HTD of testGetAfterCompaction successfully. 2023-11-30 20:54:48,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testGetAfterCompaction 620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:48,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:48,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:48,544 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:48,545 INFO [StoreOpener-620b5e5076846f009c3d67c4b1c0583f-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family f1 of region 620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:48,546 DEBUG [StoreOpener-620b5e5076846f009c3d67c4b1c0583f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1 2023-11-30 20:54:48,547 DEBUG [StoreOpener-620b5e5076846f009c3d67c4b1c0583f-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1 2023-11-30 20:54:48,547 INFO [StoreOpener-620b5e5076846f009c3d67c4b1c0583f-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 620b5e5076846f009c3d67c4b1c0583f columnFamilyName f1 2023-11-30 20:54:48,548 INFO [StoreOpener-620b5e5076846f009c3d67c4b1c0583f-1] regionserver.HStore(310): Store=620b5e5076846f009c3d67c4b1c0583f/f1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:48,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:48,549 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:48,551 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:48,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:48,553 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 620b5e5076846f009c3d67c4b1c0583f; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73506114, jitterRate=0.09532645344734192}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:54:48,553 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 620b5e5076846f009c3d67c4b1c0583f: 2023-11-30 20:54:48,554 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f., pid=73, masterSystemTime=1701377688539 2023-11-30 20:54:48,555 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:48,555 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:48,556 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=72 updating hbase:meta row=620b5e5076846f009c3d67c4b1c0583f, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:48,556 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701377688555"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377688555"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377688555"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377688555"}]},"ts":"1701377688555"} 2023-11-30 20:54:48,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=73, resume processing ppid=72 2023-11-30 20:54:48,558 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=73, ppid=72, state=SUCCESS; OpenRegionProcedure 620b5e5076846f009c3d67c4b1c0583f, server=jenkins-hbase4.apache.org,40365,1701377600631 in 170 msec 2023-11-30 20:54:48,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=72, resume processing ppid=71 2023-11-30 20:54:48,560 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=72, ppid=71, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=620b5e5076846f009c3d67c4b1c0583f, ASSIGN in 325 msec 2023-11-30 20:54:48,560 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:54:48,560 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377688560"}]},"ts":"1701377688560"} 2023-11-30 20:54:48,561 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=ENABLED in hbase:meta 2023-11-30 20:54:48,564 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=71, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testGetAfterCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:54:48,565 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=71, state=SUCCESS; CreateTableProcedure table=testGetAfterCompaction in 1.1590 sec 2023-11-30 20:54:49,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=71 2023-11-30 20:54:49,513 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testGetAfterCompaction, procId: 71 completed 2023-11-30 20:54:49,513 DEBUG [Listener at localhost/34291] hbase.HBaseTestingUtility(3430): Waiting until all regions of table testGetAfterCompaction get assigned. Timeout = 60000ms 2023-11-30 20:54:49,515 INFO [Listener at localhost/34291] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-30 20:54:49,518 INFO [Listener at localhost/34291] hbase.HBaseTestingUtility(3484): All regions for table testGetAfterCompaction assigned to meta. Checking AM states. 2023-11-30 20:54:49,519 INFO [Listener at localhost/34291] hbase.Waiter(180): Waiting up to [60,000] milli-secs(wait.for.ratio=[1]) 2023-11-30 20:54:49,519 INFO [Listener at localhost/34291] hbase.HBaseTestingUtility(3504): All regions for table testGetAfterCompaction assigned. 2023-11-30 20:54:49,523 INFO [Listener at localhost/34291] regionserver.HRegion(2745): Flushing 620b5e5076846f009c3d67c4b1c0583f 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-30 20:54:49,579 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(130): Registering adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-30 20:54:49,579 INFO [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(134): Registering RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro Metrics about HBase RegionObservers 2023-11-30 20:54:49,935 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311301aa2572f1ac74bde9fdd8a6253516a86 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311301aa2572f1ac74bde9fdd8a6253516a86 2023-11-30 20:54:50,340 INFO [Listener at localhost/34291] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/.tmp/f1/3c90939556264be2a9f3d33437799d4e 2023-11-30 20:54:50,345 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/.tmp/f1/3c90939556264be2a9f3d33437799d4e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e 2023-11-30 20:54:50,349 INFO [Listener at localhost/34291] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e, entries=1, sequenceid=5, filesize=4.9 K 2023-11-30 20:54:50,350 INFO [Listener at localhost/34291] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 620b5e5076846f009c3d67c4b1c0583f in 827ms, sequenceid=5, compaction requested=false 2023-11-30 20:54:50,351 DEBUG [Listener at localhost/34291] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testGetAfterCompaction' 2023-11-30 20:54:50,351 DEBUG [Listener at localhost/34291] regionserver.HRegion(2446): Flush status journal for 620b5e5076846f009c3d67c4b1c0583f: 2023-11-30 20:54:50,501 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(142): Chore: CompactedHFilesCleaner missed its start time 2023-11-30 20:54:50,501 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:54:50,501 INFO [AsyncFSWAL-0-hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1-prefix:jenkins-hbase4.apache.org,40365,1701377600631] wal.AbstractFSWAL(1141): Slow sync cost: 148 ms, current pipeline: [DatanodeInfoWithStorage[127.0.0.1:38669,DS-772da0b1-c481-4133-b182-857409ed6522,DISK]] 2023-11-30 20:54:50,501 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x19b6a417 to 127.0.0.1:58095 2023-11-30 20:54:50,501 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:50,501 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3fabd723 to 127.0.0.1:58095 2023-11-30 20:54:50,501 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:50,502 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:54:50,502 INFO [Listener at localhost/34291] regionserver.HRegion(2745): Flushing 620b5e5076846f009c3d67c4b1c0583f 1/1 column families, dataSize=37 B heapSize=368 B 2023-11-30 20:54:50,502 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x2e76fda4 to 127.0.0.1:58095 2023-11-30 20:54:50,502 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:50,502 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6bf02b37 to 127.0.0.1:58095 2023-11-30 20:54:50,502 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:50,502 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:54:50,502 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x3393d45e to 127.0.0.1:58095 2023-11-30 20:54:50,502 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:50,503 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:54:50,503 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x6e7d6b86 to 127.0.0.1:58095 2023-11-30 20:54:50,503 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:50,503 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:54:50,503 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x525a4722 to 127.0.0.1:58095 2023-11-30 20:54:50,503 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:50,672 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:54:50,917 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130fedf02530ffe45d28eafeedc83ccf280 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231130fedf02530ffe45d28eafeedc83ccf280 2023-11-30 20:54:51,323 INFO [Listener at localhost/34291] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=37, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/.tmp/f1/42056e9e867c4b26b2864e51426f93e7 2023-11-30 20:54:51,327 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/.tmp/f1/42056e9e867c4b26b2864e51426f93e7 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7 2023-11-30 20:54:51,331 INFO [Listener at localhost/34291] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7, entries=1, sequenceid=9, filesize=4.9 K 2023-11-30 20:54:51,332 INFO [Listener at localhost/34291] regionserver.HRegion(2948): Finished flush of dataSize ~37 B/37, heapSize ~352 B/352, currentSize=0 B/0 for 620b5e5076846f009c3d67c4b1c0583f in 829ms, sequenceid=9, compaction requested=false 2023-11-30 20:54:51,332 DEBUG [Listener at localhost/34291] regionserver.HRegion(2446): Flush status journal for 620b5e5076846f009c3d67c4b1c0583f: 2023-11-30 20:54:51,333 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=2,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'f1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testGetAfterCompaction 2023-11-30 20:54:51,334 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-30 20:54:51,335 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=74, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-30 20:54:51,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:51,336 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=74, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378291336 2023-11-30 20:54:51,336 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-30 20:54:51,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 2 selected files, and 0 irrelevant files table 'testGetAfterCompaction' and column 'f1' 2023-11-30 20:54:51,337 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testGetAfterCompaction' column='f1' 2023-11-30 20:54:51,338 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x27cdb3ae to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:51,343 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@1ff1a12a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:51,343 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231130 for table='testGetAfterCompaction' and column='f1' 2023-11-30 20:54:51,385 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,385 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,436 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,436 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,486 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,487 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,537 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,538 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,588 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,589 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,639 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,639 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,690 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,690 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,741 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,741 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,770 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130374cdd0ebbeb43c8bc386455720f4977 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231130374cdd0ebbeb43c8bc386455720f4977 2023-11-30 20:54:51,771 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='testGetAfterCompaction' column='f1' 2023-11-30 20:54:51,784 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:54:51,786 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53978, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:54:51,792 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,792 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,793 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:54:51,795 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:59680, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:54:51,806 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231130/f1/736bdeb5172c449ea55a8d1c7ba15b43 first=Optional[r1] last=Optional[r2] 2023-11-30 20:54:51,807 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{f1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231130/f1/736bdeb5172c449ea55a8d1c7ba15b43}] 2023-11-30 20:54:51,811 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231130/f1/736bdeb5172c449ea55a8d1c7ba15b43 for inclusion in 620b5e5076846f009c3d67c4b1c0583f/f1 2023-11-30 20:54:51,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r1 last=r2 2023-11-30 20:54:51,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:54:51,813 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 620b5e5076846f009c3d67c4b1c0583f: 2023-11-30 20:54:51,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231130/f1/736bdeb5172c449ea55a8d1c7ba15b43 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testGetAfterCompaction__4b6c4683clugqn5utsenkp83oql7goh406r8vsu7qolclrd4gihad5ahf1asvem7/f1/736bdeb5172c449ea55a8d1c7ba15b43 2023-11-30 20:54:51,816 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testGetAfterCompaction__4b6c4683clugqn5utsenkp83oql7goh406r8vsu7qolclrd4gihad5ahf1asvem7/f1/736bdeb5172c449ea55a8d1c7ba15b43 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_ 2023-11-30 20:54:51,817 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testGetAfterCompaction__4b6c4683clugqn5utsenkp83oql7goh406r8vsu7qolclrd4gihad5ahf1asvem7/f1/736bdeb5172c449ea55a8d1c7ba15b43 into 620b5e5076846f009c3d67c4b1c0583f/f1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_ - updating store file list. 2023-11-30 20:54:51,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_ into 620b5e5076846f009c3d67c4b1c0583f/f1 2023-11-30 20:54:51,821 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testGetAfterCompaction__4b6c4683clugqn5utsenkp83oql7goh406r8vsu7qolclrd4gihad5ahf1asvem7/f1/736bdeb5172c449ea55a8d1c7ba15b43 into 620b5e5076846f009c3d67c4b1c0583f/f1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_) 2023-11-30 20:54:51,821 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testGetAfterCompaction__4b6c4683clugqn5utsenkp83oql7goh406r8vsu7qolclrd4gihad5ahf1asvem7/f1/736bdeb5172c449ea55a8d1c7ba15b43 2023-11-30 20:54:51,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(1912): 620b5e5076846f009c3d67c4b1c0583f/f1 is initiating minor compaction 2023-11-30 20:54:51,822 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@4bf6ca43; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:51,822 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 620b5e5076846f009c3d67c4b1c0583f/f1 in testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:51,822 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/.tmp, totalSize=10.0 K 2023-11-30 20:54:51,822 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 42056e9e867c4b26b2864e51426f93e7, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-30 20:54:51,822 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 9d0990701eaf47bbb94648b793fc8959_SeqId_12_, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-30 20:54:51,824 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='testGetAfterCompaction' column='f1' 2023-11-30 20:54:51,825 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:51,826 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311301aa2572f1ac74bde9fdd8a6253516a86 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e202311301aa2572f1ac74bde9fdd8a6253516a86 2023-11-30 20:54:51,828 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231130fedf02530ffe45d28eafeedc83ccf280 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231130fedf02530ffe45d28eafeedc83ccf280 2023-11-30 20:54:51,828 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testGetAfterCompaction 2 expired mob files are deleted 2023-11-30 20:54:51,828 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testGetAfterCompaction/d41d8cd98f00b204e9800998ecf8427e20231130' 2023-11-30 20:54:51,828 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231130 for table='testGetAfterCompaction' and column='f1' 2023-11-30 20:54:51,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 1 mob files. table='testGetAfterCompaction' column='f1' 2023-11-30 20:54:51,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testGetAfterCompaction', column='f1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:54:51,829 DEBUG [PEWorker-1] locking.LockProcedure(242): UNLOCKED pid=74, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE 2023-11-30 20:54:51,830 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=74, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testGetAfterCompaction.mobLock, type=EXCLUSIVE in 495 msec 2023-11-30 20:54:51,830 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 620b5e5076846f009c3d67c4b1c0583f#f1#compaction#77 average throughput is 0.13 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:54:51,843 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,843 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,843 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:51,847 DEBUG [Listener at localhost/34291] ipc.RpcConnection(122): Using SIMPLE authentication for service=AdminService, sasl=false 2023-11-30 20:54:51,850 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:53988, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=AdminService 2023-11-30 20:54:51,850 INFO [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40365] regionserver.RSRpcServices(1662): Compacting testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:51,851 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 2 compacting, 0 eligible, 16 blocking 2023-11-30 20:54:51,851 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-30 20:54:51,851 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40365] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-30 20:54:51,851 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=40365] regionserver.CompactSplit(415): Not compacting testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. because compaction request was cancelled 2023-11-30 20:54:51,902 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,902 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,902 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:51,953 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,954 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:51,954 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,004 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,004 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,004 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,055 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,055 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,055 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,106 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,106 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,106 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,157 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,157 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,157 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,208 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,208 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,208 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,259 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,259 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,259 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,310 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,310 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,310 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,361 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,361 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,361 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,412 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,412 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,412 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,463 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,463 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,463 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,514 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,514 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,514 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,564 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,565 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,565 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,615 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,615 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,616 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,645 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/.tmp/f1/e1c3243351434347a1891522b74a8505 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/e1c3243351434347a1891522b74a8505 2023-11-30 20:54:52,649 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 2 file(s) in 620b5e5076846f009c3d67c4b1c0583f/f1 of 620b5e5076846f009c3d67c4b1c0583f into e1c3243351434347a1891522b74a8505(size=5.1 K), total size for store is 10.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:54:52,649 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 620b5e5076846f009c3d67c4b1c0583f: 2023-11-30 20:54:52,649 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f., storeName=f1, fileCount=2, fileSize=10.0 K (4.9 K, 5.1 K), priority=2, time=1701377691822; duration=0sec 2023-11-30 20:54:52,649 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:54:52,667 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,667 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377691322; access_time=1701377690507; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,667 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_; isDirectory=false; length=5206; replication=1; blocksize=134217728; modification_time=1701377691766; access_time=1701377691354; owner=jenkins; group=supergroup; permission=rwxrwxrwx; isSymlink=false} 2023-11-30 20:54:52,667 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/e1c3243351434347a1891522b74a8505; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701377692640; access_time=1701377691828; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_] to archive 2023-11-30 20:54:52,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:54:52,704 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/42056e9e867c4b26b2864e51426f93e7 2023-11-30 20:54:52,705 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/9d0990701eaf47bbb94648b793fc8959_SeqId_12_ 2023-11-30 20:54:52,717 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e; isDirectory=false; length=5015; replication=1; blocksize=134217728; modification_time=1701377690340; access_time=1701377689525; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,717 INFO [Listener at localhost/34291] compactions.TestMobCompactor(720): FileStatus{path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/e1c3243351434347a1891522b74a8505; isDirectory=false; length=5228; replication=1; blocksize=134217728; modification_time=1701377692640; access_time=1701377691828; owner=jenkins.hfs.0; group=supergroup; permission=rw-r--r--; isSymlink=false} 2023-11-30 20:54:52,833 INFO [Listener at localhost/34291] client.HBaseAdmin$15(890): Started disable of testGetAfterCompaction 2023-11-30 20:54:52,837 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testGetAfterCompaction 2023-11-30 20:54:52,843 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=75, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testGetAfterCompaction 2023-11-30 20:54:52,846 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377692846"}]},"ts":"1701377692846"} 2023-11-30 20:54:52,847 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-30 20:54:52,848 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLING in hbase:meta 2023-11-30 20:54:52,850 INFO [PEWorker-3] procedure.DisableTableProcedure(293): Set testGetAfterCompaction to state=DISABLING 2023-11-30 20:54:52,851 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=620b5e5076846f009c3d67c4b1c0583f, UNASSIGN}] 2023-11-30 20:54:52,852 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=76, ppid=75, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testGetAfterCompaction, region=620b5e5076846f009c3d67c4b1c0583f, UNASSIGN 2023-11-30 20:54:52,853 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=620b5e5076846f009c3d67c4b1c0583f, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:52,853 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701377692853"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377692853"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377692853"}]},"ts":"1701377692853"} 2023-11-30 20:54:52,854 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=77, ppid=76, state=RUNNABLE; CloseRegionProcedure 620b5e5076846f009c3d67c4b1c0583f, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:52,949 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-30 20:54:53,006 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:53,006 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:53,006 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 620b5e5076846f009c3d67c4b1c0583f, disabling compactions & flushes 2023-11-30 20:54:53,007 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:53,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:53,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. after waiting 0 ms 2023-11-30 20:54:53,007 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:53,010 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-30 20:54:53,011 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-30 20:54:53,012 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f. 2023-11-30 20:54:53,012 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 620b5e5076846f009c3d67c4b1c0583f: 2023-11-30 20:54:53,013 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:53,014 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=76 updating hbase:meta row=620b5e5076846f009c3d67c4b1c0583f, regionState=CLOSED 2023-11-30 20:54:53,014 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.","families":{"info":[{"qualifier":"regioninfo","vlen":56,"tag":[],"timestamp":"1701377693014"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377693014"}]},"ts":"1701377693014"} 2023-11-30 20:54:53,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=77, resume processing ppid=76 2023-11-30 20:54:53,016 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=77, ppid=76, state=SUCCESS; CloseRegionProcedure 620b5e5076846f009c3d67c4b1c0583f, server=jenkins-hbase4.apache.org,40365,1701377600631 in 161 msec 2023-11-30 20:54:53,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=76, resume processing ppid=75 2023-11-30 20:54:53,018 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=76, ppid=75, state=SUCCESS; TransitRegionStateProcedure table=testGetAfterCompaction, region=620b5e5076846f009c3d67c4b1c0583f, UNASSIGN in 165 msec 2023-11-30 20:54:53,018 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377693018"}]},"ts":"1701377693018"} 2023-11-30 20:54:53,019 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testGetAfterCompaction, state=DISABLED in hbase:meta 2023-11-30 20:54:53,021 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testGetAfterCompaction to state=DISABLED 2023-11-30 20:54:53,022 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=75, state=SUCCESS; DisableTableProcedure table=testGetAfterCompaction in 182 msec 2023-11-30 20:54:53,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=75 2023-11-30 20:54:53,150 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testGetAfterCompaction, procId: 75 completed 2023-11-30 20:54:53,154 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$5(2228): Client=jenkins//172.31.14.131 delete testGetAfterCompaction 2023-11-30 20:54:53,160 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION; DeleteTableProcedure table=testGetAfterCompaction 2023-11-30 20:54:53,162 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(101): Waiting for RIT for pid=78, state=RUNNABLE:DELETE_TABLE_PRE_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-30 20:54:53,163 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(113): Deleting regions from filesystem for pid=78, state=RUNNABLE:DELETE_TABLE_CLEAR_FS_LAYOUT, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-30 20:54:53,164 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-30 20:54:53,166 DEBUG [HFileArchiver-12] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:53,168 DEBUG [HFileArchiver-12] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1, FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/recovered.edits] 2023-11-30 20:54:53,171 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/3c90939556264be2a9f3d33437799d4e 2023-11-30 20:54:53,172 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/e1c3243351434347a1891522b74a8505 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/f1/e1c3243351434347a1891522b74a8505 2023-11-30 20:54:53,175 DEBUG [HFileArchiver-12] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/recovered.edits/15.seqid to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f/recovered.edits/15.seqid 2023-11-30 20:54:53,176 DEBUG [HFileArchiver-12] backup.HFileArchiver(596): Deleted hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testGetAfterCompaction/620b5e5076846f009c3d67c4b1c0583f 2023-11-30 20:54:53,176 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testGetAfterCompaction regions 2023-11-30 20:54:53,176 DEBUG [PEWorker-2] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-30 20:54:53,177 DEBUG [PEWorker-2] backup.HFileArchiver(159): Archiving [FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1] 2023-11-30 20:54:53,181 DEBUG [PEWorker-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231130374cdd0ebbeb43c8bc386455720f4977 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0/f1/d41d8cd98f00b204e9800998ecf8427e20231130374cdd0ebbeb43c8bc386455720f4977 2023-11-30 20:54:53,181 DEBUG [PEWorker-2] backup.HFileArchiver(596): Deleted hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testGetAfterCompaction/324ed642d7db99a22ebbb8cbc71c05d0 2023-11-30 20:54:53,183 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(118): Deleting regions from META for pid=78, state=RUNNABLE:DELETE_TABLE_REMOVE_FROM_META, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-30 20:54:53,205 WARN [PEWorker-2] procedure.DeleteTableProcedure(384): Deleting some vestigial 1 rows of testGetAfterCompaction from hbase:meta 2023-11-30 20:54:53,207 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(421): Removing 'testGetAfterCompaction' descriptor. 2023-11-30 20:54:53,208 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(124): Deleting assignment state for pid=78, state=RUNNABLE:DELETE_TABLE_UNASSIGN_REGIONS, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-30 20:54:53,208 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(411): Removing 'testGetAfterCompaction' from region states. 2023-11-30 20:54:53,208 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701377693208"}]},"ts":"9223372036854775807"} 2023-11-30 20:54:53,210 INFO [PEWorker-2] hbase.MetaTableAccessor(1788): Deleted 1 regions from META 2023-11-30 20:54:53,210 DEBUG [PEWorker-2] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 620b5e5076846f009c3d67c4b1c0583f, NAME => 'testGetAfterCompaction,,1701377687404.620b5e5076846f009c3d67c4b1c0583f.', STARTKEY => '', ENDKEY => ''}] 2023-11-30 20:54:53,210 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(415): Marking 'testGetAfterCompaction' as deleted. 2023-11-30 20:54:53,210 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testGetAfterCompaction","families":{"table":[{"qualifier":"state","vlen":0,"tag":[],"timestamp":"1701377693210"}]},"ts":"9223372036854775807"} 2023-11-30 20:54:53,211 INFO [PEWorker-2] hbase.MetaTableAccessor(1658): Deleted table testGetAfterCompaction state from META 2023-11-30 20:54:53,213 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(130): Finished pid=78, state=RUNNABLE:DELETE_TABLE_POST_OPERATION, locked=true; DeleteTableProcedure table=testGetAfterCompaction 2023-11-30 20:54:53,214 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=78, state=SUCCESS; DeleteTableProcedure table=testGetAfterCompaction in 58 msec 2023-11-30 20:54:53,265 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=78 2023-11-30 20:54:53,266 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: DELETE, Table Name: default:testGetAfterCompaction, procId: 78 completed 2023-11-30 20:54:53,281 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testGetAfterCompaction Thread=240 (was 256), OpenFileDescriptor=629 (was 680), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=243 (was 254), ProcessCount=172 (was 172), AvailableMemoryMB=7530 (was 7544) 2023-11-30 20:54:53,293 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=240, OpenFileDescriptor=629, MaxFileDescriptor=60000, SystemLoadAverage=243, ProcessCount=172, AvailableMemoryMB=7530 2023-11-30 20:54:53,295 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-30 20:54:53,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testCompactionWithHFileLink 2023-11-30 20:54:53,297 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:54:53,297 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testCompactionWithHFileLink" procId is: 79 2023-11-30 20:54:53,297 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:54:53,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-30 20:54:53,300 DEBUG [HFileArchiver-13] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:53,300 DEBUG [HFileArchiver-14] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:53,300 DEBUG [HFileArchiver-15] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:53,300 DEBUG [HFileArchiver-13] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9 empty. 2023-11-30 20:54:53,302 DEBUG [HFileArchiver-14] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8 empty. 2023-11-30 20:54:53,302 DEBUG [HFileArchiver-13] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:53,302 DEBUG [HFileArchiver-15] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1 empty. 2023-11-30 20:54:53,303 DEBUG [HFileArchiver-14] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:53,303 DEBUG [HFileArchiver-15] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:53,303 DEBUG [PEWorker-5] procedure.DeleteTableProcedure(328): Archived testCompactionWithHFileLink regions 2023-11-30 20:54:53,311 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-30 20:54:53,312 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(7675): creating {ENCODED => 403bb60689734a0b812ff8d53e9885e9, NAME => 'testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:54:53,312 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(7675): creating {ENCODED => 0ea9609bce6110fb1313e1d0e5a83ef8, NAME => 'testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:54:53,314 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(7675): creating {ENCODED => 01ed825bd99347cac3dd87faa7414ea1, NAME => 'testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testCompactionWithHFileLink', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:54:53,327 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:53,327 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1604): Closing 01ed825bd99347cac3dd87faa7414ea1, disabling compactions & flushes 2023-11-30 20:54:53,327 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:53,327 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:53,327 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. after waiting 0 ms 2023-11-30 20:54:53,327 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:53,328 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:53,328 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-2] regionserver.HRegion(1558): Region close journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:54:53,399 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-30 20:54:53,600 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-30 20:54:53,727 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:53,727 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1604): Closing 403bb60689734a0b812ff8d53e9885e9, disabling compactions & flushes 2023-11-30 20:54:53,727 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:53,727 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:53,727 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. after waiting 0 ms 2023-11-30 20:54:53,727 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:53,727 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:53,727 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-0] regionserver.HRegion(1558): Region close journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:54:53,729 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:53,729 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1604): Closing 0ea9609bce6110fb1313e1d0e5a83ef8, disabling compactions & flushes 2023-11-30 20:54:53,729 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:53,729 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:53,729 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. after waiting 0 ms 2023-11-30 20:54:53,729 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:53,729 INFO [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:53,729 DEBUG [RegionOpenAndInit-testCompactionWithHFileLink-pool-1] regionserver.HRegion(1558): Region close journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:54:53,732 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:54:53,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377693733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377693733"}]},"ts":"1701377693733"} 2023-11-30 20:54:53,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377693733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377693733"}]},"ts":"1701377693733"} 2023-11-30 20:54:53,733 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377693733"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377693733"}]},"ts":"1701377693733"} 2023-11-30 20:54:53,735 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-30 20:54:53,736 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:54:53,736 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377693736"}]},"ts":"1701377693736"} 2023-11-30 20:54:53,737 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-30 20:54:53,742 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, ASSIGN}, {pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, ASSIGN}, {pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, ASSIGN}] 2023-11-30 20:54:53,743 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, ASSIGN 2023-11-30 20:54:53,744 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, ASSIGN 2023-11-30 20:54:53,744 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, ASSIGN 2023-11-30 20:54:53,744 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=82, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:53,744 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=81, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:53,744 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=80, ppid=79, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:54:53,896 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=403bb60689734a0b812ff8d53e9885e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:53,896 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0ea9609bce6110fb1313e1d0e5a83ef8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:53,896 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=01ed825bd99347cac3dd87faa7414ea1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:53,896 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377693896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377693896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377693896"}]},"ts":"1701377693896"} 2023-11-30 20:54:53,896 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377693896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377693896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377693896"}]},"ts":"1701377693896"} 2023-11-30 20:54:53,896 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377693896"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377693896"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377693896"}]},"ts":"1701377693896"} 2023-11-30 20:54:53,898 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=83, ppid=81, state=RUNNABLE; OpenRegionProcedure 0ea9609bce6110fb1313e1d0e5a83ef8, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:53,898 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=84, ppid=80, state=RUNNABLE; OpenRegionProcedure 403bb60689734a0b812ff8d53e9885e9, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:53,900 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=85, ppid=82, state=RUNNABLE; OpenRegionProcedure 01ed825bd99347cac3dd87faa7414ea1, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:54:53,901 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-30 20:54:54,049 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:54,052 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:54,052 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ea9609bce6110fb1313e1d0e5a83ef8, NAME => 'testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.', STARTKEY => '1', ENDKEY => '2'} 2023-11-30 20:54:54,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:54,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:54,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:54,053 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:54,054 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:54,055 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1 2023-11-30 20:54:54,055 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1 2023-11-30 20:54:54,056 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ea9609bce6110fb1313e1d0e5a83ef8 columnFamilyName family1 2023-11-30 20:54:54,057 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(310): Store=0ea9609bce6110fb1313e1d0e5a83ef8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:54,057 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:54,058 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2 2023-11-30 20:54:54,058 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2 2023-11-30 20:54:54,059 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ea9609bce6110fb1313e1d0e5a83ef8 columnFamilyName family2 2023-11-30 20:54:54,060 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(310): Store=0ea9609bce6110fb1313e1d0e5a83ef8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:54,060 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:54,061 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:54,062 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:54:54,063 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:54:54,065 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:54,066 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ea9609bce6110fb1313e1d0e5a83ef8; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=62473123, jitterRate=-0.06907792389392853}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:54:54,066 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:54:54,067 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8., pid=83, masterSystemTime=1701377694049 2023-11-30 20:54:54,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:54,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:54,068 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:54,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01ed825bd99347cac3dd87faa7414ea1, NAME => 'testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.', STARTKEY => '2', ENDKEY => ''} 2023-11-30 20:54:54,068 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=81 updating hbase:meta row=0ea9609bce6110fb1313e1d0e5a83ef8, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:54,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:54,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:54,068 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377694068"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377694068"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377694068"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377694068"}]},"ts":"1701377694068"} 2023-11-30 20:54:54,068 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:54,069 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:54,070 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:54,071 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1 2023-11-30 20:54:54,071 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1 2023-11-30 20:54:54,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=83, resume processing ppid=81 2023-11-30 20:54:54,071 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=83, ppid=81, state=SUCCESS; OpenRegionProcedure 0ea9609bce6110fb1313e1d0e5a83ef8, server=jenkins-hbase4.apache.org,40365,1701377600631 in 172 msec 2023-11-30 20:54:54,072 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01ed825bd99347cac3dd87faa7414ea1 columnFamilyName family1 2023-11-30 20:54:54,072 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=81, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, ASSIGN in 330 msec 2023-11-30 20:54:54,073 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(310): Store=01ed825bd99347cac3dd87faa7414ea1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:54,073 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:54,074 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2 2023-11-30 20:54:54,074 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2 2023-11-30 20:54:54,075 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01ed825bd99347cac3dd87faa7414ea1 columnFamilyName family2 2023-11-30 20:54:54,075 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(310): Store=01ed825bd99347cac3dd87faa7414ea1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:54,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:54,076 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:54,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:54:54,078 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:54:54,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:54,080 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01ed825bd99347cac3dd87faa7414ea1; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=68777561, jitterRate=0.024865522980690002}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:54:54,080 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:54:54,081 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1., pid=85, masterSystemTime=1701377694049 2023-11-30 20:54:54,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:54,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:54,082 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:54,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 403bb60689734a0b812ff8d53e9885e9, NAME => 'testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.', STARTKEY => '', ENDKEY => '1'} 2023-11-30 20:54:54,082 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=82 updating hbase:meta row=01ed825bd99347cac3dd87faa7414ea1, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:54,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:54,082 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377694082"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377694082"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377694082"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377694082"}]},"ts":"1701377694082"} 2023-11-30 20:54:54,082 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:54:54,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:54,083 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:54,083 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:54,085 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1 2023-11-30 20:54:54,085 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1 2023-11-30 20:54:54,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=85, resume processing ppid=82 2023-11-30 20:54:54,085 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 403bb60689734a0b812ff8d53e9885e9 columnFamilyName family1 2023-11-30 20:54:54,085 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=85, ppid=82, state=SUCCESS; OpenRegionProcedure 01ed825bd99347cac3dd87faa7414ea1, server=jenkins-hbase4.apache.org,40365,1701377600631 in 185 msec 2023-11-30 20:54:54,086 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(310): Store=403bb60689734a0b812ff8d53e9885e9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:54,086 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=82, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, ASSIGN in 343 msec 2023-11-30 20:54:54,086 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:54,087 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2 2023-11-30 20:54:54,087 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2 2023-11-30 20:54:54,087 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 403bb60689734a0b812ff8d53e9885e9 columnFamilyName family2 2023-11-30 20:54:54,088 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(310): Store=403bb60689734a0b812ff8d53e9885e9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:54:54,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:54,089 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:54:54,091 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:54:54,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:54:54,093 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 403bb60689734a0b812ff8d53e9885e9; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=67386769, jitterRate=0.004141107201576233}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:54:54,093 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:54:54,094 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9., pid=84, masterSystemTime=1701377694049 2023-11-30 20:54:54,095 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:54,095 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:54,096 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=80 updating hbase:meta row=403bb60689734a0b812ff8d53e9885e9, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:54,096 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377694095"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377694095"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377694095"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377694095"}]},"ts":"1701377694095"} 2023-11-30 20:54:54,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=84, resume processing ppid=80 2023-11-30 20:54:54,098 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=84, ppid=80, state=SUCCESS; OpenRegionProcedure 403bb60689734a0b812ff8d53e9885e9, server=jenkins-hbase4.apache.org,40365,1701377600631 in 199 msec 2023-11-30 20:54:54,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=80, resume processing ppid=79 2023-11-30 20:54:54,099 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=80, ppid=79, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, ASSIGN in 357 msec 2023-11-30 20:54:54,100 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:54:54,100 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377694100"}]},"ts":"1701377694100"} 2023-11-30 20:54:54,101 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-30 20:54:54,103 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=79, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testCompactionWithHFileLink execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:54:54,104 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=79, state=SUCCESS; CreateTableProcedure table=testCompactionWithHFileLink in 808 msec 2023-11-30 20:54:54,402 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=79 2023-11-30 20:54:54,402 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testCompactionWithHFileLink, procId: 79 completed 2023-11-30 20:54:54,409 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:54,411 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:54,412 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:54,414 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:54,416 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-30 20:54:54,416 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-30 20:54:54,416 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:54,416 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-30 20:54:54,416 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-30 20:54:54,417 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:54,417 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:54,419 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:54,419 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:54,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:54,419 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:54,419 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:54,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:54,419 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:54,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:54,420 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:54,420 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-30 20:54:54,420 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-30 20:54:54,420 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-30 20:54:54,420 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:54,420 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-30 20:54:54,420 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:54,421 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. started... 2023-11-30 20:54:54,421 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:54,421 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. started... 2023-11-30 20:54:54,421 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:54:54,421 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:54,421 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01ed825bd99347cac3dd87faa7414ea1 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-30 20:54:54,421 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:54,422 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ea9609bce6110fb1313e1d0e5a83ef8 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-30 20:54:54,422 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. started... 2023-11-30 20:54:54,423 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 403bb60689734a0b812ff8d53e9885e9 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-30 20:54:54,436 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130419d6f50892d42b1920e77b28b915552 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130419d6f50892d42b1920e77b28b915552 2023-11-30 20:54:54,437 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130fd803205a71d4bd5a1d9d02d6db3ca05 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130fd803205a71d4bd5a1d9d02d6db3ca05 2023-11-30 20:54:54,438 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311306546e5329d774a25a4026a0890c9fa7d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311306546e5329d774a25a4026a0890c9fa7d 2023-11-30 20:54:54,444 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/4b3fabc0db2445ba9659532eb7b22739 2023-11-30 20:54:54,446 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/fee583d8b3f1490381d50bacf3ef068a 2023-11-30 20:54:54,842 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/32079abba267402ca1735206f791b4d0 2023-11-30 20:54:54,858 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023113092aeee01e56e42d2bb94d2c3dd37a87b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113092aeee01e56e42d2bb94d2c3dd37a87b 2023-11-30 20:54:54,862 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130b656ddbe7f094cc5855d89b26fbf0180 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b656ddbe7f094cc5855d89b26fbf0180 2023-11-30 20:54:55,257 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130ce89dffa6091483fbd6bfaab4cdc7872 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130ce89dffa6091483fbd6bfaab4cdc7872 2023-11-30 20:54:55,263 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/446b7f31db84408bbf483a130fd5972b 2023-11-30 20:54:55,267 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/7448739e94b141f9b706058e32b1442b 2023-11-30 20:54:55,267 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/4b3fabc0db2445ba9659532eb7b22739 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/4b3fabc0db2445ba9659532eb7b22739 2023-11-30 20:54:55,271 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/4b3fabc0db2445ba9659532eb7b22739, entries=4, sequenceid=5, filesize=5.4 K 2023-11-30 20:54:55,271 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/fee583d8b3f1490381d50bacf3ef068a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/fee583d8b3f1490381d50bacf3ef068a 2023-11-30 20:54:55,272 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/446b7f31db84408bbf483a130fd5972b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/446b7f31db84408bbf483a130fd5972b 2023-11-30 20:54:55,275 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/fee583d8b3f1490381d50bacf3ef068a, entries=4, sequenceid=5, filesize=5.4 K 2023-11-30 20:54:55,276 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/7448739e94b141f9b706058e32b1442b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/7448739e94b141f9b706058e32b1442b 2023-11-30 20:54:55,276 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/446b7f31db84408bbf483a130fd5972b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-30 20:54:55,277 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 0ea9609bce6110fb1313e1d0e5a83ef8 in 855ms, sequenceid=5, compaction requested=false 2023-11-30 20:54:55,277 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testCompactionWithHFileLink' 2023-11-30 20:54:55,277 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:54:55,277 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:55,277 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:54:55,279 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/7448739e94b141f9b706058e32b1442b, entries=2, sequenceid=5, filesize=5.1 K 2023-11-30 20:54:55,280 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 403bb60689734a0b812ff8d53e9885e9 in 857ms, sequenceid=5, compaction requested=false 2023-11-30 20:54:55,281 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:54:55,281 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:55,281 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:54:55,662 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/e83d4ccfd77343d8a98ce1000f42c3ff 2023-11-30 20:54:55,666 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/32079abba267402ca1735206f791b4d0 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/32079abba267402ca1735206f791b4d0 2023-11-30 20:54:55,670 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/32079abba267402ca1735206f791b4d0, entries=4, sequenceid=5, filesize=5.4 K 2023-11-30 20:54:55,671 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/e83d4ccfd77343d8a98ce1000f42c3ff as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e83d4ccfd77343d8a98ce1000f42c3ff 2023-11-30 20:54:55,675 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e83d4ccfd77343d8a98ce1000f42c3ff, entries=2, sequenceid=5, filesize=5.1 K 2023-11-30 20:54:55,676 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 01ed825bd99347cac3dd87faa7414ea1 in 1255ms, sequenceid=5, compaction requested=false 2023-11-30 20:54:55,676 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:54:55,676 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:54:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:54:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-30 20:54:55,676 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-30 20:54:55,679 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:55,679 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:55,679 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:55,679 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:55,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:55,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-30 20:54:55,681 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@a46409[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:55,681 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-30 20:54:55,681 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:55,682 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:55,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:55,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:55,682 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-30 20:54:55,682 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,683 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:55,682 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-30 20:54:55,683 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:55,684 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-30 20:54:55,684 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,684 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:55,684 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:55,684 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-30 20:54:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:55,685 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:55,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:55,686 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,687 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:55,687 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-30 20:54:55,687 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-30 20:54:55,687 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:55,687 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:55,687 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-30 20:54:55,687 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:55,688 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:55,688 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:55,688 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:55,688 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:55,688 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:55,689 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:55,689 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:55,689 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:55,690 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,690 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:55,691 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,693 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,693 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:55,693 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:55,693 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:55,693 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:55,693 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:55,693 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,693 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:55,693 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:55,693 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-30 20:54:55,694 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:55,693 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:55,694 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:55,694 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:55,694 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:55,694 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:55,694 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-30 20:54:55,694 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:55,694 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:55,794 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:55,795 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:55,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:55,796 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:55,797 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:55,799 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:55,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:55,801 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-30 20:54:55,801 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-30 20:54:55,801 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:55,801 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-30 20:54:55,801 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-30 20:54:55,802 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:55,802 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:55,803 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,803 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:55,803 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:55,803 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:55,804 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:55,804 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:55,804 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:55,804 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:55,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:55,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:55,805 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-30 20:54:55,805 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-30 20:54:55,805 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-30 20:54:55,805 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-30 20:54:55,805 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:55,805 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-30 20:54:55,806 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:55,806 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:55,806 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. started... 2023-11-30 20:54:55,806 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. started... 2023-11-30 20:54:55,806 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ea9609bce6110fb1313e1d0e5a83ef8 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-30 20:54:55,806 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01ed825bd99347cac3dd87faa7414ea1 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-30 20:54:55,812 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:54:55,812 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:55,812 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:55,812 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. started... 2023-11-30 20:54:55,812 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 403bb60689734a0b812ff8d53e9885e9 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-30 20:54:56,234 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130fb4e481905394205a5eadaef51c09c81 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130fb4e481905394205a5eadaef51c09c81 2023-11-30 20:54:56,234 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130f35c7885afb540919833db0c12f4e7d3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130f35c7885afb540919833db0c12f4e7d3 2023-11-30 20:54:56,242 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113099479eb9ec2a47ccb65c7b64cabde0a2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113099479eb9ec2a47ccb65c7b64cabde0a2 2023-11-30 20:54:56,640 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/5328d89ed9df4868ab7db70d09635356 2023-11-30 20:54:56,640 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/83820ba9973a44c8b9790d7f023c01cd 2023-11-30 20:54:56,647 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/d0696ac8f1d348f392bf7161d1a74257 2023-11-30 20:54:57,056 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130b39cbc07f6f14bffbbf65ead3ba9e77d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b39cbc07f6f14bffbbf65ead3ba9e77d 2023-11-30 20:54:57,056 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130356cc59cca7c42069cc083ec0333d407 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130356cc59cca7c42069cc083ec0333d407 2023-11-30 20:54:57,061 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113028bd1a85f5ca41ac9ad8a25214e4a2f7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023113028bd1a85f5ca41ac9ad8a25214e4a2f7 2023-11-30 20:54:57,072 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/27af4c497e904fd7a7d12d04be5a6357 2023-11-30 20:54:57,072 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/f7c7c680c4d34784a21436eef5c564ed 2023-11-30 20:54:57,074 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/477ebe4cf30745e58dfa03633401f81c 2023-11-30 20:54:57,078 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/5328d89ed9df4868ab7db70d09635356 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/5328d89ed9df4868ab7db70d09635356 2023-11-30 20:54:57,078 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/83820ba9973a44c8b9790d7f023c01cd as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/83820ba9973a44c8b9790d7f023c01cd 2023-11-30 20:54:57,080 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/d0696ac8f1d348f392bf7161d1a74257 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/d0696ac8f1d348f392bf7161d1a74257 2023-11-30 20:54:57,082 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/83820ba9973a44c8b9790d7f023c01cd, entries=4, sequenceid=9, filesize=5.4 K 2023-11-30 20:54:57,082 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/5328d89ed9df4868ab7db70d09635356, entries=4, sequenceid=9, filesize=5.4 K 2023-11-30 20:54:57,083 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/27af4c497e904fd7a7d12d04be5a6357 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/27af4c497e904fd7a7d12d04be5a6357 2023-11-30 20:54:57,083 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/f7c7c680c4d34784a21436eef5c564ed as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/f7c7c680c4d34784a21436eef5c564ed 2023-11-30 20:54:57,085 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/d0696ac8f1d348f392bf7161d1a74257, entries=4, sequenceid=9, filesize=5.4 K 2023-11-30 20:54:57,086 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/477ebe4cf30745e58dfa03633401f81c as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/477ebe4cf30745e58dfa03633401f81c 2023-11-30 20:54:57,088 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/f7c7c680c4d34784a21436eef5c564ed, entries=2, sequenceid=9, filesize=5.1 K 2023-11-30 20:54:57,088 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/27af4c497e904fd7a7d12d04be5a6357, entries=2, sequenceid=9, filesize=5.1 K 2023-11-30 20:54:57,089 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 0ea9609bce6110fb1313e1d0e5a83ef8 in 1283ms, sequenceid=9, compaction requested=false 2023-11-30 20:54:57,089 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 403bb60689734a0b812ff8d53e9885e9 in 1277ms, sequenceid=9, compaction requested=false 2023-11-30 20:54:57,089 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:54:57,089 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:54:57,089 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:57,089 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:57,089 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:54:57,089 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:54:57,091 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/477ebe4cf30745e58dfa03633401f81c, entries=2, sequenceid=9, filesize=5.1 K 2023-11-30 20:54:57,091 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 01ed825bd99347cac3dd87faa7414ea1 in 1285ms, sequenceid=9, compaction requested=false 2023-11-30 20:54:57,091 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:54:57,091 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:57,091 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:54:57,091 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:54:57,091 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,091 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-30 20:54:57,092 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-30 20:54:57,097 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,097 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:57,097 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:57,097 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:57,097 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,098 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:57,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-30 20:54:57,098 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@3754bd5d[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:57,098 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-30 20:54:57,099 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:57,100 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:57,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:57,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:57,100 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-30 20:54:57,100 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-30 20:54:57,100 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:57,100 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,100 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:57,101 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-30 20:54:57,101 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,101 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:57,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:57,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:57,101 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-30 20:54:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:57,102 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:57,103 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,104 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:57,104 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-30 20:54:57,104 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-30 20:54:57,104 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:57,104 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:57,104 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-30 20:54:57,104 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:57,106 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:57,106 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:57,106 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:57,106 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:57,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:57,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:57,106 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:57,107 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:57,107 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:57,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:57,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:57,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:57,108 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:57,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:57,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,110 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,110 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:57,111 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:57,111 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,111 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:57,111 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:57,111 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:57,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-30 20:54:57,111 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:57,111 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:57,111 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-30 20:54:57,111 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:57,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:57,111 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:57,111 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:57,111 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:57,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:57,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:57,211 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:57,212 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:57,213 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:57,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:57,214 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:57,217 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:57,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:57,219 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-30 20:54:57,219 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-30 20:54:57,219 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:57,219 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-30 20:54:57,219 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-30 20:54:57,220 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:57,220 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:57,221 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:57,221 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,221 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:57,221 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:57,221 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:57,222 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:57,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:57,222 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:57,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:57,222 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:57,222 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-30 20:54:57,222 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-30 20:54:57,223 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-30 20:54:57,223 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-30 20:54:57,223 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:57,223 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-30 20:54:57,223 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:57,223 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. started... 2023-11-30 20:54:57,223 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:57,223 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. started... 2023-11-30 20:54:57,223 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:57,223 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01ed825bd99347cac3dd87faa7414ea1 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-30 20:54:57,223 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ea9609bce6110fb1313e1d0e5a83ef8 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-30 20:54:57,223 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:54:57,223 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:57,223 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. started... 2023-11-30 20:54:57,223 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 403bb60689734a0b812ff8d53e9885e9 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-30 20:54:57,246 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130c535296bd486440aaac6975a86d23ccc to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130c535296bd486440aaac6975a86d23ccc 2023-11-30 20:54:57,648 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130c04d061eea1f4569b29abf5816c2a1ac to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130c04d061eea1f4569b29abf5816c2a1ac 2023-11-30 20:54:57,648 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113001022efbefb24aaeba59cb60ba4ff004 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113001022efbefb24aaeba59cb60ba4ff004 2023-11-30 20:54:57,651 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/9c69ecd96ca848018737b813febb37b8 2023-11-30 20:54:57,653 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/8f361c5604b9491c91c549db6a9719c1 2023-11-30 20:54:57,668 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130c0ca3121f8304ded9df2e89ba67783e0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130c0ca3121f8304ded9df2e89ba67783e0 2023-11-30 20:54:58,054 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/f83b3fbd38734f6cada2e54c90a538a7 2023-11-30 20:54:58,067 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311301538720718a14d9caef1c95204645160 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311301538720718a14d9caef1c95204645160 2023-11-30 20:54:58,067 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023113035c9d951b6f64285b55a0db2a16e0343 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023113035c9d951b6f64285b55a0db2a16e0343 2023-11-30 20:54:58,072 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/eee1098d6ca049ac9caca067a04706b8 2023-11-30 20:54:58,076 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/8f361c5604b9491c91c549db6a9719c1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/8f361c5604b9491c91c549db6a9719c1 2023-11-30 20:54:58,079 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/8f361c5604b9491c91c549db6a9719c1, entries=4, sequenceid=13, filesize=5.4 K 2023-11-30 20:54:58,080 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/eee1098d6ca049ac9caca067a04706b8 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/eee1098d6ca049ac9caca067a04706b8 2023-11-30 20:54:58,083 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/eee1098d6ca049ac9caca067a04706b8, entries=2, sequenceid=13, filesize=5.1 K 2023-11-30 20:54:58,083 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 01ed825bd99347cac3dd87faa7414ea1 in 860ms, sequenceid=13, compaction requested=true 2023-11-30 20:54:58,084 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:54:58,084 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:58,084 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:54:58,472 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/b6dc491483184d198d4d54fffd425394 2023-11-30 20:54:58,472 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/3ca96eebd6354289b72f4761476dde1b 2023-11-30 20:54:58,477 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/f83b3fbd38734f6cada2e54c90a538a7 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f83b3fbd38734f6cada2e54c90a538a7 2023-11-30 20:54:58,477 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/9c69ecd96ca848018737b813febb37b8 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/9c69ecd96ca848018737b813febb37b8 2023-11-30 20:54:58,481 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/9c69ecd96ca848018737b813febb37b8, entries=4, sequenceid=13, filesize=5.4 K 2023-11-30 20:54:58,481 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f83b3fbd38734f6cada2e54c90a538a7, entries=4, sequenceid=13, filesize=5.4 K 2023-11-30 20:54:58,482 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/3ca96eebd6354289b72f4761476dde1b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/3ca96eebd6354289b72f4761476dde1b 2023-11-30 20:54:58,482 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/b6dc491483184d198d4d54fffd425394 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/b6dc491483184d198d4d54fffd425394 2023-11-30 20:54:58,486 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/3ca96eebd6354289b72f4761476dde1b, entries=2, sequenceid=13, filesize=5.1 K 2023-11-30 20:54:58,486 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/b6dc491483184d198d4d54fffd425394, entries=2, sequenceid=13, filesize=5.1 K 2023-11-30 20:54:58,487 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 403bb60689734a0b812ff8d53e9885e9 in 1264ms, sequenceid=13, compaction requested=true 2023-11-30 20:54:58,487 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 0ea9609bce6110fb1313e1d0e5a83ef8 in 1264ms, sequenceid=13, compaction requested=true 2023-11-30 20:54:58,487 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:54:58,487 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:58,487 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:54:58,487 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:54:58,487 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:58,487 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:54:58,487 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:54:58,487 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,487 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-30 20:54:58,487 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-30 20:54:58,489 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,489 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:58,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:58,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:58,489 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:58,489 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:58,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:58,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:58,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:58,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:58,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-30 20:54:58,491 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@776fd15a[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:58,491 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-30 20:54:58,491 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:58,493 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:58,493 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:58,493 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:58,493 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-30 20:54:58,493 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-30 20:54:58,493 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:58,493 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,493 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:58,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,494 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-30 20:54:58,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:58,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:58,494 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:58,494 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-30 20:54:58,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:58,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:58,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:58,495 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:58,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:58,496 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,497 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:58,497 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-30 20:54:58,497 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-30 20:54:58,497 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:58,497 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:58,497 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-30 20:54:58,497 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:58,498 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:58,498 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:58,498 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:58,498 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:58,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:58,498 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:58,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:58,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:58,499 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:58,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:58,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:58,499 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:58,499 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:58,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:58,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:58,500 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,500 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:58,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:58,501 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:58,503 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:58,503 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:58,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-30 20:54:58,503 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:58,503 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:58,503 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:58,503 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:58,504 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:58,514 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:54:58,604 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:58,604 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:58,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:58,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:58,606 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:54:58,609 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:54:58,610 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-30 20:54:58,611 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-30 20:54:58,611 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-30 20:54:58,611 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:58,611 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-30 20:54:58,611 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-30 20:54:58,611 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:58,611 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:58,615 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,615 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:58,616 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:58,616 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:58,616 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:58,616 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:58,616 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:54:58,617 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:58,617 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-30 20:54:58,617 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-30 20:54:58,617 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-30 20:54:58,617 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-30 20:54:58,617 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:54:58,617 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-30 20:54:58,617 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:58,617 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. started... 2023-11-30 20:54:58,617 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:58,617 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. started... 2023-11-30 20:54:58,617 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:54:58,618 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01ed825bd99347cac3dd87faa7414ea1 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-30 20:54:58,618 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ea9609bce6110fb1313e1d0e5a83ef8 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-30 20:54:58,618 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:54:58,617 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:58,618 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. started... 2023-11-30 20:54:58,618 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 403bb60689734a0b812ff8d53e9885e9 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-30 20:54:58,647 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130ac27f80ec04844ed9b448e4e0290b3cb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130ac27f80ec04844ed9b448e4e0290b3cb 2023-11-30 20:54:58,651 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130b29884754c7d40d6a8b3ba2f50792192 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130b29884754c7d40d6a8b3ba2f50792192 2023-11-30 20:54:58,651 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130d1a07191760f4cd999afd0c3861fad14 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130d1a07191760f4cd999afd0c3861fad14 2023-11-30 20:54:58,660 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/f4dface6e29b4f4284e3983996f2ad4d 2023-11-30 20:54:59,061 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/d5fc256bca694ca189a88e74cf1d51b4 2023-11-30 20:54:59,062 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/a2f784fc39944e75944ea0381694de0b 2023-11-30 20:54:59,075 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130eb58982bac24436081a40f39c8267e87 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130eb58982bac24436081a40f39c8267e87 2023-11-30 20:54:59,086 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/931cd85217e845a5bd300146bdc5d24b 2023-11-30 20:54:59,088 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023113082498e9565f340b8b04ca4c728de3374 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113082498e9565f340b8b04ca4c728de3374 2023-11-30 20:54:59,089 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311306b5bd5973489411b8940f73fc70acf9b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311306b5bd5973489411b8940f73fc70acf9b 2023-11-30 20:54:59,091 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/f4dface6e29b4f4284e3983996f2ad4d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/f4dface6e29b4f4284e3983996f2ad4d 2023-11-30 20:54:59,097 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/f4dface6e29b4f4284e3983996f2ad4d, entries=4, sequenceid=17, filesize=5.4 K 2023-11-30 20:54:59,098 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/931cd85217e845a5bd300146bdc5d24b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/931cd85217e845a5bd300146bdc5d24b 2023-11-30 20:54:59,101 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/931cd85217e845a5bd300146bdc5d24b, entries=2, sequenceid=17, filesize=5.1 K 2023-11-30 20:54:59,102 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 01ed825bd99347cac3dd87faa7414ea1 in 485ms, sequenceid=17, compaction requested=true 2023-11-30 20:54:59,102 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:54:59,102 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:59,102 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:54:59,497 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/e0eecfe010694b6b87674eefa37ce9cf 2023-11-30 20:54:59,497 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/91ed6412283d4c489156efa3d7a4837c 2023-11-30 20:54:59,502 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/a2f784fc39944e75944ea0381694de0b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/a2f784fc39944e75944ea0381694de0b 2023-11-30 20:54:59,505 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/d5fc256bca694ca189a88e74cf1d51b4 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/d5fc256bca694ca189a88e74cf1d51b4 2023-11-30 20:54:59,505 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/a2f784fc39944e75944ea0381694de0b, entries=4, sequenceid=17, filesize=5.4 K 2023-11-30 20:54:59,506 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/e0eecfe010694b6b87674eefa37ce9cf as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/e0eecfe010694b6b87674eefa37ce9cf 2023-11-30 20:54:59,509 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/d5fc256bca694ca189a88e74cf1d51b4, entries=4, sequenceid=17, filesize=5.4 K 2023-11-30 20:54:59,510 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/91ed6412283d4c489156efa3d7a4837c as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/91ed6412283d4c489156efa3d7a4837c 2023-11-30 20:54:59,510 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/e0eecfe010694b6b87674eefa37ce9cf, entries=2, sequenceid=17, filesize=5.1 K 2023-11-30 20:54:59,511 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 0ea9609bce6110fb1313e1d0e5a83ef8 in 893ms, sequenceid=17, compaction requested=true 2023-11-30 20:54:59,511 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:54:59,511 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:59,511 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:54:59,513 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/91ed6412283d4c489156efa3d7a4837c, entries=2, sequenceid=17, filesize=5.1 K 2023-11-30 20:54:59,514 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 403bb60689734a0b812ff8d53e9885e9 in 896ms, sequenceid=17, compaction requested=true 2023-11-30 20:54:59,514 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:54:59,514 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:59,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:54:59,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:54:59,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-30 20:54:59,514 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-30 20:54:59,516 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:59,516 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:59,516 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:59,517 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:59,517 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:59,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:59,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:59,517 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:59,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,518 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:59,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-30 20:54:59,518 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50dbc350[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:59,518 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-30 20:54:59,518 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:59,519 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:59,520 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:59,520 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:59,520 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-30 20:54:59,520 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,520 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:59,520 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-30 20:54:59,520 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:54:59,521 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,521 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-30 20:54:59,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:59,521 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:59,521 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:59,521 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-30 20:54:59,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:59,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:59,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:59,522 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:59,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:59,523 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,524 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:54:59,524 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-30 20:54:59,524 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:54:59,524 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:54:59,524 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-30 20:54:59,524 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-30 20:54:59,524 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:54:59,526 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:59,526 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:54:59,526 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:59,526 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:59,526 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:59,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:59,527 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:59,527 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,527 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:59,528 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:59,529 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:59,529 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:54:59,530 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:59,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:54:59,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:54:59,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:54:59,531 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:54:59,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,531 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:54:59,531 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:54:59,531 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-30 20:54:59,531 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-30 20:54:59,532 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:54:59,531 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:59,532 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:54:59,532 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:54:59,532 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:54:59,532 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:54:59,532 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:59,532 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:54:59,579 DEBUG [HBase-Metrics2-1] impl.GlobalMetricRegistriesAdapter(152): Removing adapter for the MetricRegistry: RegionServer,sub=Coprocessor.Region.CP_org.apache.hadoop.hbase.mob.compactions.TestMobCompactor$CompactTwoLatestHfilesCopro 2023-11-30 20:54:59,632 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:54:59,633 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:54:59,643 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-30 20:54:59,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1701377699643 (current time:1701377699643). 2023-11-30 20:54:59,643 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-30 20:54:59,644 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] zookeeper.ReadOnlyZKClient(139): Connect 0x69635f29 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:54:59,651 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@6010553f, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:54:59,655 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:54:59,658 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:45862, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:54:59,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x69635f29 to 127.0.0.1:58095 2023-11-30 20:54:59,659 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:54:59,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-30 20:54:59,660 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotManager(684): Table enabled, starting distributed snapshots for { ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-30 20:54:59,672 WARN [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot, current working dir path: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/snaptb-1701377699633 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotEnabledTable(SnapshotManager.java:559) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:687) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-30 20:54:59,679 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-30 20:54:59,680 DEBUG [PEWorker-5] locking.LockProcedure(309): LOCKED pid=86, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-30 20:54:59,681 INFO [PEWorker-5] procedure2.TimeoutExecutorThread(81): ADDED pid=86, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1701378299681 2023-11-30 20:54:59,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotManager(689): Started snapshot: { ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-30 20:54:59,681 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running FLUSH table snapshot snaptb-1701377699633 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-30 20:54:59,682 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=86, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-30 20:54:59,683 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure2.ProcedureExecutor(1075): Stored pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-30 20:54:59,683 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=86, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 4 msec 2023-11-30 20:54:59,684 DEBUG [PEWorker-2] locking.LockProcedure(309): LOCKED pid=87, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-30 20:54:59,685 INFO [PEWorker-2] procedure2.TimeoutExecutorThread(81): ADDED pid=87, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED; timeout=600000, timestamp=1701378299685 2023-11-30 20:54:59,687 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-30 20:54:59,687 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-30 20:54:59,696 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] procedure.ProcedureCoordinator(165): Submitting procedure snaptb-1701377699633 2023-11-30 20:54:59,696 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'snaptb-1701377699633' 2023-11-30 20:54:59,696 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-30 20:54:59,696 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'snaptb-1701377699633' starting 'acquire' 2023-11-30 20:54:59,696 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'snaptb-1701377699633', kicking off acquire phase on members. 2023-11-30 20:54:59,697 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1701377699633 2023-11-30 20:54:59,697 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/online-snapshot/acquired/snaptb-1701377699633 2023-11-30 20:54:59,698 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-30 20:54:59,698 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/online-snapshot/acquired/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,698 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-30 20:54:59,698 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-30 20:54:59,699 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/acquired/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,699 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:54:59,699 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/online-snapshot/acquired/snaptb-1701377699633 2023-11-30 20:54:59,699 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/abort/snaptb-1701377699633 2023-11-30 20:54:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 68 2023-11-30 20:54:59,700 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/online-snapshot/acquired/snaptb-1701377699633 2023-11-30 20:54:59,700 DEBUG [zk-event-processor-pool-0] snapshot.RegionServerSnapshotManager(175): Launching subprocedure for snapshot snaptb-1701377699633 from table testCompactionWithHFileLink type FLUSH 2023-11-30 20:54:59,702 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:snaptb-1701377699633 2023-11-30 20:54:59,703 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'snaptb-1701377699633' with timeout 300000ms 2023-11-30 20:54:59,703 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 300000 ms 2023-11-30 20:54:59,703 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'snaptb-1701377699633' starting 'acquire' stage 2023-11-30 20:54:59,703 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'snaptb-1701377699633' locally acquired 2023-11-30 20:54:59,703 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (snaptb-1701377699633) in zk 2023-11-30 20:54:59,704 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/online-snapshot/reached/snaptb-1701377699633 2023-11-30 20:54:59,704 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/acquired/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:54:59,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-30 20:54:59,705 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1701377699633 2023-11-30 20:54:59,705 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'snaptb-1701377699633' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:54:59,705 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:54:59,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:54:59,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701377699633 2023-11-30 20:54:59,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:54:59,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'snaptb-1701377699633' on coordinator 2023-11-30 20:54:59,707 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@737c616e[Count = 0] remaining members to acquire global barrier 2023-11-30 20:54:59,707 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'snaptb-1701377699633' starting 'in-barrier' execution. 2023-11-30 20:54:59,707 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/online-snapshot/reached/snaptb-1701377699633 2023-11-30 20:54:59,708 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701377699633 2023-11-30 20:54:59,708 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/reached/snaptb-1701377699633 2023-11-30 20:54:59,708 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/online-snapshot/reached/snaptb-1701377699633 2023-11-30 20:54:59,708 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'snaptb-1701377699633' received 'reached' from coordinator. 2023-11-30 20:54:59,708 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/online-snapshot/reached/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:54:59,708 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:54:59,709 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:59,709 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] snapshot.FlushSnapshotSubprocedure(170): Flush Snapshot Tasks submitted for 3 regions 2023-11-30 20:54:59,710 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:59,709 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(97): Starting snapshot operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:54:59,710 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(301): Waiting for local region snapshots to finish. 2023-11-30 20:54:59,710 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. started... 2023-11-30 20:54:59,710 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. started... 2023-11-30 20:54:59,710 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(110): Flush Snapshotting region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. started... 2023-11-30 20:54:59,710 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] regionserver.HRegion(2446): Flush status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:54:59,710 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] regionserver.HRegion(2446): Flush status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:54:59,710 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] regionserver.HRegion(2446): Flush status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:54:59,711 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.' region-info for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,711 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.' region-info for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,711 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(238): Storing 'testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.' region-info for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,716 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-30 20:54:59,716 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-30 20:54:59,716 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(243): Creating references for hfiles 2023-11-30 20:54:59,719 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/4b3fabc0db2445ba9659532eb7b22739, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/5328d89ed9df4868ab7db70d09635356, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f83b3fbd38734f6cada2e54c90a538a7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/a2f784fc39944e75944ea0381694de0b] hfiles 2023-11-30 20:54:59,720 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/32079abba267402ca1735206f791b4d0, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/d0696ac8f1d348f392bf7161d1a74257, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/8f361c5604b9491c91c549db6a9719c1, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/f4dface6e29b4f4284e3983996f2ad4d] hfiles 2023-11-30 20:54:59,720 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/fee583d8b3f1490381d50bacf3ef068a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/83820ba9973a44c8b9790d7f023c01cd, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/9c69ecd96ca848018737b813febb37b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/d5fc256bca694ca189a88e74cf1d51b4] hfiles 2023-11-30 20:54:59,720 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/32079abba267402ca1735206f791b4d0 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,720 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/fee583d8b3f1490381d50bacf3ef068a for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,720 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/4b3fabc0db2445ba9659532eb7b22739 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,724 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/5328d89ed9df4868ab7db70d09635356 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,724 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/d0696ac8f1d348f392bf7161d1a74257 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,724 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/83820ba9973a44c8b9790d7f023c01cd for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/8f361c5604b9491c91c549db6a9719c1 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/9c69ecd96ca848018737b813febb37b8 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/f4dface6e29b4f4284e3983996f2ad4d for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f83b3fbd38734f6cada2e54c90a538a7 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/d5fc256bca694ca189a88e74cf1d51b4 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/a2f784fc39944e75944ea0381694de0b for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/7448739e94b141f9b706058e32b1442b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/27af4c497e904fd7a7d12d04be5a6357, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/3ca96eebd6354289b72f4761476dde1b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/91ed6412283d4c489156efa3d7a4837c] hfiles 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/446b7f31db84408bbf483a130fd5972b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/f7c7c680c4d34784a21436eef5c564ed, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/b6dc491483184d198d4d54fffd425394, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/e0eecfe010694b6b87674eefa37ce9cf] hfiles 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/7448739e94b141f9b706058e32b1442b for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/446b7f31db84408bbf483a130fd5972b for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/f7c7c680c4d34784a21436eef5c564ed for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(253): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e83d4ccfd77343d8a98ce1000f42c3ff, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/477ebe4cf30745e58dfa03633401f81c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/eee1098d6ca049ac9caca067a04706b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/931cd85217e845a5bd300146bdc5d24b] hfiles 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/b6dc491483184d198d4d54fffd425394 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/27af4c497e904fd7a7d12d04be5a6357 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/e0eecfe010694b6b87674eefa37ce9cf for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/3ca96eebd6354289b72f4761476dde1b for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (1/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e83d4ccfd77343d8a98ce1000f42c3ff for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/91ed6412283d4c489156efa3d7a4837c for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (2/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/477ebe4cf30745e58dfa03633401f81c for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (3/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/eee1098d6ca049ac9caca067a04706b8 for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,725 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.SnapshotManifest(262): Adding reference for file (4/4): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/931cd85217e845a5bd300146bdc5d24b for snapshot=snaptb-1701377699633 2023-11-30 20:54:59,745 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. completed. 2023-11-30 20:54:59,745 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. completed. 2023-11-30 20:54:59,745 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-0] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:54:59,745 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-2] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:54:59,746 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 1/3 local region snapshots. 2023-11-30 20:54:59,746 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 2/3 local region snapshots. 2023-11-30 20:54:59,787 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:54:59,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:54:59,792 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-30 20:54:59,792 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-30 20:54:59,992 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:54:59,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:54:59,993 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-30 20:54:59,994 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-30 20:55:00,145 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(137): ... Flush Snapshotting region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. completed. 2023-11-30 20:55:00,145 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-snapshot-pool-1] snapshot.FlushSnapshotSubprocedure$RegionSnapshotTask(140): Closing snapshot operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:00,145 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(312): Completed 3/3 local region snapshots. 2023-11-30 20:55:00,145 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(314): Completed 3 local region snapshots. 2023-11-30 20:55:00,145 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] snapshot.RegionServerSnapshotManager$SnapshotSubprocedurePool(345): cancelling 0 tasks for snapshot jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,145 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'snaptb-1701377699633' locally completed 2023-11-30 20:55:00,146 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'snaptb-1701377699633' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:00,148 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,148 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'snaptb-1701377699633' has notified controller of completion 2023-11-30 20:55:00,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/reached/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:00,148 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-30 20:55:00,148 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:00,148 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'snaptb-1701377699633' completed. 2023-11-30 20:55:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701377699633 2023-11-30 20:55:00,149 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701377699633 2023-11-30 20:55:00,150 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,151 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'snaptb-1701377699633' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:00,151 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'snaptb-1701377699633', counting down latch. Waiting for 0 more 2023-11-30 20:55:00,151 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'snaptb-1701377699633' execution completed 2023-11-30 20:55:00,151 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:00,151 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:00,151 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:snaptb-1701377699633 2023-11-30 20:55:00,151 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure snaptb-1701377699633including nodes /hbase/online-snapshot/acquired /hbase/online-snapshot/reached /hbase/online-snapshot/abort 2023-11-30 20:55:00,153 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701377699633 2023-11-30 20:55:00,153 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701377699633 2023-11-30 20:55:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/online-snapshot/abort/snaptb-1701377699633 2023-11-30 20:55:00,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/online-snapshot/abort/snaptb-1701377699633 2023-11-30 20:55:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/online-snapshot 2023-11-30 20:55:00,153 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-30 20:55:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1701377699633 2023-11-30 20:55:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:00,153 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-30 20:55:00,153 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-30 20:55:00,153 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/acquired/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701377699633 2023-11-30 20:55:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/online-snapshot/abort/snaptb-1701377699633 2023-11-30 20:55:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:00,154 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701377699633 2023-11-30 20:55:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,155 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/online-snapshot/reached/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:00,155 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----snaptb-1701377699633 2023-11-30 20:55:00,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,157 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,157 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701377699633 2023-11-30 20:55:00,157 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/acquired 2023-11-30 20:55:00,158 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/acquired/snaptb-1701377699633 2023-11-30 20:55:00,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/online-snapshot/acquired 2023-11-30 20:55:00,158 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(97): Done waiting - online snapshot for snaptb-1701377699633 2023-11-30 20:55:00,158 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701377699633/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:00,158 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/abort 2023-11-30 20:55:00,158 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:00,158 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.EnabledTableSnapshotHandler(113): Taking snapshot for mob files in table testCompactionWithHFileLink 2023-11-30 20:55:00,158 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701377699633 2023-11-30 20:55:00,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/online-snapshot/acquired' 2023-11-30 20:55:00,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(191): Storing mob region '{ENCODED => 0e7b6fa9e81bd62588edd7d77d6165e4, NAME => 'testCompactionWithHFileLink,.mob,0.0e7b6fa9e81bd62588edd7d77d6165e4.', STARTKEY => '.mob', ENDKEY => ''}' region-info for snapshot=snaptb-1701377699633 2023-11-30 20:55:00,158 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/reached/snaptb-1701377699633 2023-11-30 20:55:00,158 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(196): Creating references for mob files 2023-11-30 20:55:00,158 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/online-snapshot/abort/snaptb-1701377699633 2023-11-30 20:55:00,158 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/online-snapshot/abort 2023-11-30 20:55:00,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/online-snapshot/abort' 2023-11-30 20:55:00,159 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130b29884754c7d40d6a8b3ba2f50792192, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130c04d061eea1f4569b29abf5816c2a1ac, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130f35c7885afb540919833db0c12f4e7d3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130fd803205a71d4bd5a1d9d02d6db3ca05, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113001022efbefb24aaeba59cb60ba4ff004, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130419d6f50892d42b1920e77b28b915552, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113099479eb9ec2a47ccb65c7b64cabde0a2, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130ac27f80ec04844ed9b448e4e0290b3cb, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311306546e5329d774a25a4026a0890c9fa7d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130c535296bd486440aaac6975a86d23ccc, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130d1a07191760f4cd999afd0c3861fad14, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130fb4e481905394205a5eadaef51c09c81] mob files 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130b29884754c7d40d6a8b3ba2f50792192 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130c04d061eea1f4569b29abf5816c2a1ac 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130f35c7885afb540919833db0c12f4e7d3 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130fd803205a71d4bd5a1d9d02d6db3ca05 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113001022efbefb24aaeba59cb60ba4ff004 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130419d6f50892d42b1920e77b28b915552 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113099479eb9ec2a47ccb65c7b64cabde0a2 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130ac27f80ec04844ed9b448e4e0290b3cb 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311306546e5329d774a25a4026a0890c9fa7d 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130c535296bd486440aaac6975a86d23ccc 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130d1a07191760f4cd999afd0c3861fad14 2023-11-30 20:55:00,160 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130fb4e481905394205a5eadaef51c09c81 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311301538720718a14d9caef1c95204645160, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130356cc59cca7c42069cc083ec0333d407, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113082498e9565f340b8b04ca4c728de3374, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113092aeee01e56e42d2bb94d2c3dd37a87b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023113028bd1a85f5ca41ac9ad8a25214e4a2f7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130c0ca3121f8304ded9df2e89ba67783e0, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130ce89dffa6091483fbd6bfaab4cdc7872, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130eb58982bac24436081a40f39c8267e87, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023113035c9d951b6f64285b55a0db2a16e0343, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311306b5bd5973489411b8940f73fc70acf9b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b39cbc07f6f14bffbbf65ead3ba9e77d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b656ddbe7f094cc5855d89b26fbf0180] mob files 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (1/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311301538720718a14d9caef1c95204645160 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (2/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130356cc59cca7c42069cc083ec0333d407 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (3/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113082498e9565f340b8b04ca4c728de3374 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (4/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113092aeee01e56e42d2bb94d2c3dd37a87b 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (5/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023113028bd1a85f5ca41ac9ad8a25214e4a2f7 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (6/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130c0ca3121f8304ded9df2e89ba67783e0 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (7/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130ce89dffa6091483fbd6bfaab4cdc7872 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (8/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130eb58982bac24436081a40f39c8267e87 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (9/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023113035c9d951b6f64285b55a0db2a16e0343 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (10/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311306b5bd5973489411b8940f73fc70acf9b 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (11/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b39cbc07f6f14bffbbf65ead3ba9e77d 2023-11-30 20:55:00,161 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(363): Adding reference for mob file (12/12): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b656ddbe7f094cc5855d89b26fbf0180 2023-11-30 20:55:00,294 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:55:00,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:55:00,295 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-30 20:55:00,295 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-30 20:55:00,566 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for snaptb-1701377699633 2023-11-30 20:55:00,568 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/snaptb-1701377699633 2023-11-30 20:55:00,795 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:55:00,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:55:00,796 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotManager(406): Snapshoting '{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-30 20:55:00,797 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-30 20:55:01,015 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/snaptb-1701377699633 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/snaptb-1701377699633 2023-11-30 20:55:01,016 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot snaptb-1701377699633 of table testCompactionWithHFileLink completed 2023-11-30 20:55:01,016 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/snaptb-1701377699633 2023-11-30 20:55:01,016 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/snaptb-1701377699633 2023-11-30 20:55:01,017 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running FLUSH table snapshot snaptb-1701377699633 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1701377699681Completed referencing HFiles for the mob region of table: testCompactionWithHFileLink at 1701377700566 (+885 ms)Consolidate snapshot: snaptb-1701377699633 at 1701377700566Loading Region manifests for snaptb-1701377699633 at 1701377700567 (+1 ms)Writing data manifest for snaptb-1701377699633 at 1701377700576 (+9 ms)Verifying snapshot: snaptb-1701377699633 at 1701377700983 (+407 ms)Snapshot snaptb-1701377699633 of table testCompactionWithHFileLink completed at 1701377701016 (+33 ms) 2023-11-30 20:55:01,017 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=87, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED 2023-11-30 20:55:01,019 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=87, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=SHARED in 1.3350 sec 2023-11-30 20:55:01,797 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:55:01,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:55:01,798 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] snapshot.SnapshotManager(403): Snapshot '{ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-30 20:55:01,830 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:01,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testCompactionWithHFileLink was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:01,831 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testCompactionWithHFileLink 2023-11-30 20:55:01,831 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testCompactionWithHFileLink' 2023-11-30 20:55:01,831 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:01,832 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testCompactionWithHFileLink' starting 'acquire' 2023-11-30 20:55:01,832 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testCompactionWithHFileLink', kicking off acquire phase on members. 2023-11-30 20:55:01,832 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:55:01,832 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:55:01,834 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:01,834 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:01,834 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:01,834 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:01,834 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:01,834 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:55:01,834 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:55:01,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:01,835 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:55:01,835 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testCompactionWithHFileLink 2023-11-30 20:55:01,835 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testCompactionWithHFileLink is still present, removing 2023-11-30 20:55:01,835 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testCompactionWithHFileLink 2023-11-30 20:55:01,836 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testCompactionWithHFileLink' with timeout 60000ms 2023-11-30 20:55:01,836 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:01,836 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testCompactionWithHFileLink' starting 'acquire' stage 2023-11-30 20:55:01,836 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:01,836 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. started... 2023-11-30 20:55:01,836 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:01,836 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. started... 2023-11-30 20:55:01,836 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 01ed825bd99347cac3dd87faa7414ea1 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-30 20:55:01,836 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing 0ea9609bce6110fb1313e1d0e5a83ef8 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-30 20:55:01,837 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:01,837 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:01,837 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:01,837 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. started... 2023-11-30 20:55:01,838 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 403bb60689734a0b812ff8d53e9885e9 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-30 20:55:02,658 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/771f9486abac40c9b14c752a022d814d 2023-11-30 20:55:02,662 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 771f9486abac40c9b14c752a022d814d 2023-11-30 20:55:02,664 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/5f50cf89fef1418f9a6315899d80d7e8 2023-11-30 20:55:02,664 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/3c7438a8956b4abcbab030b1a71bd98b 2023-11-30 20:55:02,669 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f50cf89fef1418f9a6315899d80d7e8 2023-11-30 20:55:02,677 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c7438a8956b4abcbab030b1a71bd98b 2023-11-30 20:55:02,683 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/3129a569beaf44fdadc18c7463f50e49 2023-11-30 20:55:02,687 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3129a569beaf44fdadc18c7463f50e49 2023-11-30 20:55:02,688 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/771f9486abac40c9b14c752a022d814d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/771f9486abac40c9b14c752a022d814d 2023-11-30 20:55:02,689 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/14551c8b5eec43f9bb26f3230a9dfb54 2023-11-30 20:55:02,692 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 771f9486abac40c9b14c752a022d814d 2023-11-30 20:55:02,692 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/771f9486abac40c9b14c752a022d814d, entries=3, sequenceid=24, filesize=5.0 K 2023-11-30 20:55:02,693 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/3129a569beaf44fdadc18c7463f50e49 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/3129a569beaf44fdadc18c7463f50e49 2023-11-30 20:55:02,693 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14551c8b5eec43f9bb26f3230a9dfb54 2023-11-30 20:55:02,693 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/3c7438a8956b4abcbab030b1a71bd98b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3c7438a8956b4abcbab030b1a71bd98b 2023-11-30 20:55:02,696 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3129a569beaf44fdadc18c7463f50e49 2023-11-30 20:55:02,697 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/3129a569beaf44fdadc18c7463f50e49, entries=1, sequenceid=24, filesize=5.0 K 2023-11-30 20:55:02,697 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3c7438a8956b4abcbab030b1a71bd98b 2023-11-30 20:55:02,697 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3c7438a8956b4abcbab030b1a71bd98b, entries=3, sequenceid=24, filesize=5.0 K 2023-11-30 20:55:02,697 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 0ea9609bce6110fb1313e1d0e5a83ef8 in 861ms, sequenceid=24, compaction requested=true 2023-11-30 20:55:02,698 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:55:02,698 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:02,698 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:02,698 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/14551c8b5eec43f9bb26f3230a9dfb54 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/14551c8b5eec43f9bb26f3230a9dfb54 2023-11-30 20:55:02,702 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 14551c8b5eec43f9bb26f3230a9dfb54 2023-11-30 20:55:02,703 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/14551c8b5eec43f9bb26f3230a9dfb54, entries=1, sequenceid=24, filesize=5.0 K 2023-11-30 20:55:02,703 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 403bb60689734a0b812ff8d53e9885e9 in 865ms, sequenceid=24, compaction requested=true 2023-11-30 20:55:02,704 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:55:02,704 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:02,704 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:03,086 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=24, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/a63a450bb8be43dd8fa607f764d27644 2023-11-30 20:55:03,090 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a63a450bb8be43dd8fa607f764d27644 2023-11-30 20:55:03,091 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/5f50cf89fef1418f9a6315899d80d7e8 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/5f50cf89fef1418f9a6315899d80d7e8 2023-11-30 20:55:03,094 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5f50cf89fef1418f9a6315899d80d7e8 2023-11-30 20:55:03,094 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/5f50cf89fef1418f9a6315899d80d7e8, entries=3, sequenceid=24, filesize=5.0 K 2023-11-30 20:55:03,095 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/a63a450bb8be43dd8fa607f764d27644 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/a63a450bb8be43dd8fa607f764d27644 2023-11-30 20:55:03,099 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for a63a450bb8be43dd8fa607f764d27644 2023-11-30 20:55:03,099 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/a63a450bb8be43dd8fa607f764d27644, entries=1, sequenceid=24, filesize=5.0 K 2023-11-30 20:55:03,100 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 01ed825bd99347cac3dd87faa7414ea1 in 1264ms, sequenceid=24, compaction requested=true 2023-11-30 20:55:03,100 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:55:03,100 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:03,100 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:03,100 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:03,100 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,100 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testCompactionWithHFileLink' locally acquired 2023-11-30 20:55:03,100 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testCompactionWithHFileLink) in zk 2023-11-30 20:55:03,107 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,107 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:55:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:03,107 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:03,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:55:03,108 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testCompactionWithHFileLink' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:03,108 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:55:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:03,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testCompactionWithHFileLink' on coordinator 2023-11-30 20:55:03,109 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@61d08409[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:03,109 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testCompactionWithHFileLink' starting 'in-barrier' execution. 2023-11-30 20:55:03,109 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:55:03,111 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:55:03,111 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:55:03,111 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:55:03,111 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testCompactionWithHFileLink' received 'reached' from coordinator. 2023-11-30 20:55:03,111 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testCompactionWithHFileLink' locally completed 2023-11-30 20:55:03,111 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testCompactionWithHFileLink' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:03,111 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,111 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:03,112 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testCompactionWithHFileLink' has notified controller of completion 2023-11-30 20:55:03,112 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,112 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:03,112 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:03,112 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testCompactionWithHFileLink' completed. 2023-11-30 20:55:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:55:03,113 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:55:03,114 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,115 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testCompactionWithHFileLink' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:03,115 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testCompactionWithHFileLink', counting down latch. Waiting for 0 more 2023-11-30 20:55:03,115 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testCompactionWithHFileLink' execution completed 2023-11-30 20:55:03,115 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:03,115 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:03,115 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testCompactionWithHFileLink 2023-11-30 20:55:03,115 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testCompactionWithHFileLinkincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:03,117 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:55:03,117 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:55:03,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:55:03,117 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:55:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:55:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:03,117 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:03,117 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:03,117 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:03,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:55:03,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:55:03,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:03,118 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:55:03,119 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:03,119 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testCompactionWithHFileLink 2023-11-30 20:55:03,120 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,122 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,122 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:55:03,122 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testCompactionWithHFileLink 2023-11-30 20:55:03,122 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:03,122 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:03,122 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:03,122 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:03,122 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testCompactionWithHFileLink' 2023-11-30 20:55:03,123 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testCompactionWithHFileLink because node does not exist (not an error) 2023-11-30 20:55:03,122 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:03,122 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:55:03,122 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:03,123 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testCompactionWithHFileLink 2023-11-30 20:55:03,123 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:03,123 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testCompactionWithHFileLink 2023-11-30 20:55:03,123 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:03,123 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:03,123 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testCompactionWithHFileLink'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:03,123 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:03,223 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:03,224 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:03,225 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:03,225 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 01ed825bd99347cac3dd87faa7414ea1/family1 is initiating major compaction (all files) 2023-11-30 20:55:03,226 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:03,226 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:03,226 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 01ed825bd99347cac3dd87faa7414ea1/family1 in testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:03,227 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/32079abba267402ca1735206f791b4d0, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/d0696ac8f1d348f392bf7161d1a74257, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/8f361c5604b9491c91c549db6a9719c1, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/f4dface6e29b4f4284e3983996f2ad4d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/5f50cf89fef1418f9a6315899d80d7e8] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp, totalSize=26.7 K 2023-11-30 20:55:03,227 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 32079abba267402ca1735206f791b4d0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694412 2023-11-30 20:55:03,228 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting d0696ac8f1d348f392bf7161d1a74257, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695797 2023-11-30 20:55:03,228 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 8f361c5604b9491c91c549db6a9719c1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697214 2023-11-30 20:55:03,229 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting f4dface6e29b4f4284e3983996f2ad4d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:03,229 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 5f50cf89fef1418f9a6315899d80d7e8, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-30 20:55:03,242 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 01ed825bd99347cac3dd87faa7414ea1#family1#compaction#108 average throughput is 0.85 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:03,651 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023113015c44dbf7aad494d89fc3d9fb700b8be_del 2023-11-30 20:55:03,651 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113015c44dbf7aad494d89fc3d9fb700b8be_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113015c44dbf7aad494d89fc3d9fb700b8be_del 2023-11-30 20:55:04,464 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 310bd88ae77f435091a5c0e132d8e35d 2023-11-30 20:55:04,465 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/310bd88ae77f435091a5c0e132d8e35d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/310bd88ae77f435091a5c0e132d8e35d 2023-11-30 20:55:04,468 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 310bd88ae77f435091a5c0e132d8e35d 2023-11-30 20:55:04,469 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 01ed825bd99347cac3dd87faa7414ea1/family1 of 01ed825bd99347cac3dd87faa7414ea1 into 310bd88ae77f435091a5c0e132d8e35d(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:04,469 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:55:04,470 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:04,470 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 01ed825bd99347cac3dd87faa7414ea1/family2 is initiating major compaction (all files) 2023-11-30 20:55:04,470 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:04,470 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:04,470 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 01ed825bd99347cac3dd87faa7414ea1/family2 in testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:04,471 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e83d4ccfd77343d8a98ce1000f42c3ff, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/477ebe4cf30745e58dfa03633401f81c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/eee1098d6ca049ac9caca067a04706b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/931cd85217e845a5bd300146bdc5d24b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/a63a450bb8be43dd8fa607f764d27644] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp, totalSize=25.4 K 2023-11-30 20:55:04,471 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting e83d4ccfd77343d8a98ce1000f42c3ff, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694412 2023-11-30 20:55:04,471 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 477ebe4cf30745e58dfa03633401f81c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695797 2023-11-30 20:55:04,472 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting eee1098d6ca049ac9caca067a04706b8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697214 2023-11-30 20:55:04,472 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 931cd85217e845a5bd300146bdc5d24b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:04,472 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting a63a450bb8be43dd8fa607f764d27644, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-30 20:55:04,483 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 01ed825bd99347cac3dd87faa7414ea1#family2#compaction#109 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:04,494 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231130db234c8c4e0c42b4ac8f9197755c585c_del 2023-11-30 20:55:04,494 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130db234c8c4e0c42b4ac8f9197755c585c_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130db234c8c4e0c42b4ac8f9197755c585c_del 2023-11-30 20:55:04,501 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/32079abba267402ca1735206f791b4d0, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/d0696ac8f1d348f392bf7161d1a74257, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/8f361c5604b9491c91c549db6a9719c1, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/f4dface6e29b4f4284e3983996f2ad4d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/5f50cf89fef1418f9a6315899d80d7e8] to archive 2023-11-30 20:55:04,502 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:04,504 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/32079abba267402ca1735206f791b4d0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/32079abba267402ca1735206f791b4d0 2023-11-30 20:55:04,505 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/d0696ac8f1d348f392bf7161d1a74257 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/d0696ac8f1d348f392bf7161d1a74257 2023-11-30 20:55:04,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/8f361c5604b9491c91c549db6a9719c1 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/8f361c5604b9491c91c549db6a9719c1 2023-11-30 20:55:04,506 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/f4dface6e29b4f4284e3983996f2ad4d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/f4dface6e29b4f4284e3983996f2ad4d 2023-11-30 20:55:04,507 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/5f50cf89fef1418f9a6315899d80d7e8 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/5f50cf89fef1418f9a6315899d80d7e8 2023-11-30 20:55:05,082 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:55:05,312 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e66f84aeab2c4aa7a2b1f9070b378a1f 2023-11-30 20:55:05,312 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/e66f84aeab2c4aa7a2b1f9070b378a1f as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e66f84aeab2c4aa7a2b1f9070b378a1f 2023-11-30 20:55:05,316 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for e66f84aeab2c4aa7a2b1f9070b378a1f 2023-11-30 20:55:05,317 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 01ed825bd99347cac3dd87faa7414ea1/family2 of 01ed825bd99347cac3dd87faa7414ea1 into e66f84aeab2c4aa7a2b1f9070b378a1f(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:05,317 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:55:05,317 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:05,318 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 0ea9609bce6110fb1313e1d0e5a83ef8/family1 is initiating major compaction (all files) 2023-11-30 20:55:05,318 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:05,318 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:05,318 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 0ea9609bce6110fb1313e1d0e5a83ef8/family1 in testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:05,318 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/4b3fabc0db2445ba9659532eb7b22739, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/5328d89ed9df4868ab7db70d09635356, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f83b3fbd38734f6cada2e54c90a538a7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/a2f784fc39944e75944ea0381694de0b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/771f9486abac40c9b14c752a022d814d] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp, totalSize=26.7 K 2023-11-30 20:55:05,318 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 4b3fabc0db2445ba9659532eb7b22739, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694411 2023-11-30 20:55:05,319 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 5328d89ed9df4868ab7db70d09635356, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695796 2023-11-30 20:55:05,319 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting f83b3fbd38734f6cada2e54c90a538a7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697214 2023-11-30 20:55:05,319 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting a2f784fc39944e75944ea0381694de0b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:05,320 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 771f9486abac40c9b14c752a022d814d, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-30 20:55:05,331 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 0ea9609bce6110fb1313e1d0e5a83ef8#family1#compaction#110 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:05,401 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e83d4ccfd77343d8a98ce1000f42c3ff, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/477ebe4cf30745e58dfa03633401f81c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/eee1098d6ca049ac9caca067a04706b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/931cd85217e845a5bd300146bdc5d24b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/a63a450bb8be43dd8fa607f764d27644] to archive 2023-11-30 20:55:05,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:05,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e83d4ccfd77343d8a98ce1000f42c3ff to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e83d4ccfd77343d8a98ce1000f42c3ff 2023-11-30 20:55:05,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/477ebe4cf30745e58dfa03633401f81c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/477ebe4cf30745e58dfa03633401f81c 2023-11-30 20:55:05,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/eee1098d6ca049ac9caca067a04706b8 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/eee1098d6ca049ac9caca067a04706b8 2023-11-30 20:55:05,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/931cd85217e845a5bd300146bdc5d24b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/931cd85217e845a5bd300146bdc5d24b 2023-11-30 20:55:05,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/a63a450bb8be43dd8fa607f764d27644 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/a63a450bb8be43dd8fa607f764d27644 2023-11-30 20:55:05,740 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231130700751d6af824590bf23176023f093d6_del 2023-11-30 20:55:05,740 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130700751d6af824590bf23176023f093d6_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130700751d6af824590bf23176023f093d6_del 2023-11-30 20:55:06,555 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03c0bfad65454beaa863f3244776358d 2023-11-30 20:55:06,556 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/03c0bfad65454beaa863f3244776358d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/03c0bfad65454beaa863f3244776358d 2023-11-30 20:55:06,559 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 03c0bfad65454beaa863f3244776358d 2023-11-30 20:55:06,561 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0ea9609bce6110fb1313e1d0e5a83ef8/family1 of 0ea9609bce6110fb1313e1d0e5a83ef8 into 03c0bfad65454beaa863f3244776358d(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:06,561 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:55:06,561 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:06,561 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 0ea9609bce6110fb1313e1d0e5a83ef8/family2 is initiating major compaction (all files) 2023-11-30 20:55:06,561 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:06,561 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:06,562 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 0ea9609bce6110fb1313e1d0e5a83ef8/family2 in testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:06,562 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/446b7f31db84408bbf483a130fd5972b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/f7c7c680c4d34784a21436eef5c564ed, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/b6dc491483184d198d4d54fffd425394, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/e0eecfe010694b6b87674eefa37ce9cf, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/3129a569beaf44fdadc18c7463f50e49] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp, totalSize=25.4 K 2023-11-30 20:55:06,563 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 446b7f31db84408bbf483a130fd5972b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694411 2023-11-30 20:55:06,563 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting f7c7c680c4d34784a21436eef5c564ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695796 2023-11-30 20:55:06,563 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting b6dc491483184d198d4d54fffd425394, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697214 2023-11-30 20:55:06,564 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting e0eecfe010694b6b87674eefa37ce9cf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:06,564 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 3129a569beaf44fdadc18c7463f50e49, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-30 20:55:06,576 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 0ea9609bce6110fb1313e1d0e5a83ef8#family2#compaction#111 average throughput is 0.53 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:06,601 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/4b3fabc0db2445ba9659532eb7b22739, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/5328d89ed9df4868ab7db70d09635356, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f83b3fbd38734f6cada2e54c90a538a7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/a2f784fc39944e75944ea0381694de0b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/771f9486abac40c9b14c752a022d814d] to archive 2023-11-30 20:55:06,602 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:06,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/4b3fabc0db2445ba9659532eb7b22739 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/4b3fabc0db2445ba9659532eb7b22739 2023-11-30 20:55:06,605 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/5328d89ed9df4868ab7db70d09635356 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/5328d89ed9df4868ab7db70d09635356 2023-11-30 20:55:06,606 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f83b3fbd38734f6cada2e54c90a538a7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f83b3fbd38734f6cada2e54c90a538a7 2023-11-30 20:55:06,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/a2f784fc39944e75944ea0381694de0b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/a2f784fc39944e75944ea0381694de0b 2023-11-30 20:55:06,608 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/771f9486abac40c9b14c752a022d814d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/771f9486abac40c9b14c752a022d814d 2023-11-30 20:55:06,984 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231130bd163db4497546cd92b653dd076e147f_del 2023-11-30 20:55:06,984 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130bd163db4497546cd92b653dd076e147f_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130bd163db4497546cd92b653dd076e147f_del 2023-11-30 20:55:07,798 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d781a9d48a447fdaf4d714b515a074e 2023-11-30 20:55:07,799 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/5d781a9d48a447fdaf4d714b515a074e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/5d781a9d48a447fdaf4d714b515a074e 2023-11-30 20:55:07,802 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5d781a9d48a447fdaf4d714b515a074e 2023-11-30 20:55:07,803 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 0ea9609bce6110fb1313e1d0e5a83ef8/family2 of 0ea9609bce6110fb1313e1d0e5a83ef8 into 5d781a9d48a447fdaf4d714b515a074e(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:07,803 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:55:07,803 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:07,804 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 403bb60689734a0b812ff8d53e9885e9/family1 is initiating major compaction (all files) 2023-11-30 20:55:07,804 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:07,804 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:07,804 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 403bb60689734a0b812ff8d53e9885e9/family1 in testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:07,804 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/fee583d8b3f1490381d50bacf3ef068a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/83820ba9973a44c8b9790d7f023c01cd, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/9c69ecd96ca848018737b813febb37b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/d5fc256bca694ca189a88e74cf1d51b4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3c7438a8956b4abcbab030b1a71bd98b] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp, totalSize=26.7 K 2023-11-30 20:55:07,804 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting fee583d8b3f1490381d50bacf3ef068a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694409 2023-11-30 20:55:07,805 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 83820ba9973a44c8b9790d7f023c01cd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695796 2023-11-30 20:55:07,805 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 9c69ecd96ca848018737b813febb37b8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697213 2023-11-30 20:55:07,806 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting d5fc256bca694ca189a88e74cf1d51b4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:07,806 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 3c7438a8956b4abcbab030b1a71bd98b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-30 20:55:07,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/446b7f31db84408bbf483a130fd5972b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/f7c7c680c4d34784a21436eef5c564ed, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/b6dc491483184d198d4d54fffd425394, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/e0eecfe010694b6b87674eefa37ce9cf, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/3129a569beaf44fdadc18c7463f50e49] to archive 2023-11-30 20:55:07,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:07,813 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/446b7f31db84408bbf483a130fd5972b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/446b7f31db84408bbf483a130fd5972b 2023-11-30 20:55:07,815 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/f7c7c680c4d34784a21436eef5c564ed to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/f7c7c680c4d34784a21436eef5c564ed 2023-11-30 20:55:07,816 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/b6dc491483184d198d4d54fffd425394 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/b6dc491483184d198d4d54fffd425394 2023-11-30 20:55:07,817 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/e0eecfe010694b6b87674eefa37ce9cf to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/e0eecfe010694b6b87674eefa37ce9cf 2023-11-30 20:55:07,819 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/3129a569beaf44fdadc18c7463f50e49 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/3129a569beaf44fdadc18c7463f50e49 2023-11-30 20:55:07,819 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 403bb60689734a0b812ff8d53e9885e9#family1#compaction#112 average throughput is 0.57 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:08,233 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231130f86251ba666e47889b82d2370c078902_del 2023-11-30 20:55:08,233 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130f86251ba666e47889b82d2370c078902_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130f86251ba666e47889b82d2370c078902_del 2023-11-30 20:55:09,048 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3de9019222f5447382ee660a301dc81a 2023-11-30 20:55:09,049 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/3de9019222f5447382ee660a301dc81a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3de9019222f5447382ee660a301dc81a 2023-11-30 20:55:09,054 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3de9019222f5447382ee660a301dc81a 2023-11-30 20:55:09,055 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 403bb60689734a0b812ff8d53e9885e9/family1 of 403bb60689734a0b812ff8d53e9885e9 into 3de9019222f5447382ee660a301dc81a(size=6.9 K), total size for store is 6.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:09,055 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:55:09,055 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:09,055 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 403bb60689734a0b812ff8d53e9885e9/family2 is initiating major compaction (all files) 2023-11-30 20:55:09,055 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:09,055 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:09,056 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 403bb60689734a0b812ff8d53e9885e9/family2 in testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:09,056 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/7448739e94b141f9b706058e32b1442b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/27af4c497e904fd7a7d12d04be5a6357, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/3ca96eebd6354289b72f4761476dde1b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/91ed6412283d4c489156efa3d7a4837c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/14551c8b5eec43f9bb26f3230a9dfb54] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp, totalSize=25.4 K 2023-11-30 20:55:09,056 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 7448739e94b141f9b706058e32b1442b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694409 2023-11-30 20:55:09,057 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 27af4c497e904fd7a7d12d04be5a6357, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695796 2023-11-30 20:55:09,057 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 3ca96eebd6354289b72f4761476dde1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697213 2023-11-30 20:55:09,058 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 91ed6412283d4c489156efa3d7a4837c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:09,058 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 14551c8b5eec43f9bb26f3230a9dfb54, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=24, earliestPutTs=9223372036854775807 2023-11-30 20:55:09,069 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 403bb60689734a0b812ff8d53e9885e9#family2#compaction#113 average throughput is 0.35 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:09,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/fee583d8b3f1490381d50bacf3ef068a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/83820ba9973a44c8b9790d7f023c01cd, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/9c69ecd96ca848018737b813febb37b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/d5fc256bca694ca189a88e74cf1d51b4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3c7438a8956b4abcbab030b1a71bd98b] to archive 2023-11-30 20:55:09,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:09,105 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/fee583d8b3f1490381d50bacf3ef068a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/fee583d8b3f1490381d50bacf3ef068a 2023-11-30 20:55:09,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/83820ba9973a44c8b9790d7f023c01cd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/83820ba9973a44c8b9790d7f023c01cd 2023-11-30 20:55:09,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/9c69ecd96ca848018737b813febb37b8 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/9c69ecd96ca848018737b813febb37b8 2023-11-30 20:55:09,109 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/d5fc256bca694ca189a88e74cf1d51b4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/d5fc256bca694ca189a88e74cf1d51b4 2023-11-30 20:55:09,110 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3c7438a8956b4abcbab030b1a71bd98b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3c7438a8956b4abcbab030b1a71bd98b 2023-11-30 20:55:09,478 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311307b2515f8f40c438e91b612191720e3b9_del 2023-11-30 20:55:09,478 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311307b2515f8f40c438e91b612191720e3b9_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311307b2515f8f40c438e91b612191720e3b9_del 2023-11-30 20:55:10,301 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c285d850b050482383c23563d2f95452 2023-11-30 20:55:10,302 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/c285d850b050482383c23563d2f95452 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/c285d850b050482383c23563d2f95452 2023-11-30 20:55:10,305 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c285d850b050482383c23563d2f95452 2023-11-30 20:55:10,306 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 403bb60689734a0b812ff8d53e9885e9/family2 of 403bb60689734a0b812ff8d53e9885e9 into c285d850b050482383c23563d2f95452(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:10,306 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:55:10,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/7448739e94b141f9b706058e32b1442b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/27af4c497e904fd7a7d12d04be5a6357, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/3ca96eebd6354289b72f4761476dde1b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/91ed6412283d4c489156efa3d7a4837c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/14551c8b5eec43f9bb26f3230a9dfb54] to archive 2023-11-30 20:55:10,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:10,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/7448739e94b141f9b706058e32b1442b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/7448739e94b141f9b706058e32b1442b 2023-11-30 20:55:10,312 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:10,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/27af4c497e904fd7a7d12d04be5a6357 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/27af4c497e904fd7a7d12d04be5a6357 2023-11-30 20:55:10,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/3ca96eebd6354289b72f4761476dde1b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/3ca96eebd6354289b72f4761476dde1b 2023-11-30 20:55:10,316 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:10,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/91ed6412283d4c489156efa3d7a4837c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/91ed6412283d4c489156efa3d7a4837c 2023-11-30 20:55:10,318 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/14551c8b5eec43f9bb26f3230a9dfb54 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/14551c8b5eec43f9bb26f3230a9dfb54 2023-11-30 20:55:10,322 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:10,323 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:10,328 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-30 20:55:10,359 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-30 20:55:10,362 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231130f86251ba666e47889b82d2370c078902_del 2023-11-30 20:55:10,365 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231130700751d6af824590bf23176023f093d6_del 2023-11-30 20:55:10,368 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c2023113015c44dbf7aad494d89fc3d9fb700b8be_del 2023-11-30 20:55:10,368 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:10,369 DEBUG [Listener at localhost/34291] zookeeper.ReadOnlyZKClient(139): Connect 0x297558a3 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:55:10,373 DEBUG [Listener at localhost/34291] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@3b2cec99, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:55:10,373 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:10,374 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:10,374 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:11,234 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311305e2c1a2718554ea096ddcecabd2bea87 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311305e2c1a2718554ea096ddcecabd2bea87 2023-11-30 20:55:11,235 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:11,241 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023113039ab5c5a901e438dbeb6516e248680d9 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023113039ab5c5a901e438dbeb6516e248680d9 2023-11-30 20:55:11,241 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130445e4b7fa3bd4239ab7a2c7230a4aeaa to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130445e4b7fa3bd4239ab7a2c7230a4aeaa 2023-11-30 20:55:11,242 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:11,242 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:11,253 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:55:11,257 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42356, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:55:11,265 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:55:11,268 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:49764, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:55:11,283 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130/family1/ee433d715588463a907d29f05595247d first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-30 20:55:11,284 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130/family1/356700fc03d9463287c023af81e8c87a first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-30 20:55:11,284 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130/family1/ee433d715588463a907d29f05595247d}] 2023-11-30 20:55:11,284 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130/family1/73f26311125c4d38bd0b759db8bdd42a first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-30 20:55:11,286 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130/family1/356700fc03d9463287c023af81e8c87a}] 2023-11-30 20:55:11,286 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130/family1/73f26311125c4d38bd0b759db8bdd42a}] 2023-11-30 20:55:11,294 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130/family1/ee433d715588463a907d29f05595247d for inclusion in 0ea9609bce6110fb1313e1d0e5a83ef8/family1 2023-11-30 20:55:11,294 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130/family1/73f26311125c4d38bd0b759db8bdd42a for inclusion in 01ed825bd99347cac3dd87faa7414ea1/family1 2023-11-30 20:55:11,295 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130/family1/356700fc03d9463287c023af81e8c87a for inclusion in 403bb60689734a0b812ff8d53e9885e9/family1 2023-11-30 20:55:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-30 20:55:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-30 20:55:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-30 20:55:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:55:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-30 20:55:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last=1 2023-11-30 20:55:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:55:11,297 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-30 20:55:11,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:55:11,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130/family1/73f26311125c4d38bd0b759db8bdd42a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__nbjqo8bemlh940j35r7sge7jqdu89osgvvtntjf5ba141ecjo0j3oo9p5vk094it/family1/73f26311125c4d38bd0b759db8bdd42a 2023-11-30 20:55:11,298 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130/family1/356700fc03d9463287c023af81e8c87a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__i9vdnoposuga9ktc9esb6pd57ud0agnuu7b53o6v0g5sn9csm54dg8q30s5qet3t/family1/356700fc03d9463287c023af81e8c87a 2023-11-30 20:55:11,299 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130/family1/ee433d715588463a907d29f05595247d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__9vejrr8g0rncrgb05ttgc8tmafo7434hg6s5i16r5dv4glkj8n4hvk49nvtbo782/family1/ee433d715588463a907d29f05595247d 2023-11-30 20:55:11,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__nbjqo8bemlh940j35r7sge7jqdu89osgvvtntjf5ba141ecjo0j3oo9p5vk094it/family1/73f26311125c4d38bd0b759db8bdd42a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/2b3c1b31184648b7af55dca07d2c6681_SeqId_29_ 2023-11-30 20:55:11,301 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__9vejrr8g0rncrgb05ttgc8tmafo7434hg6s5i16r5dv4glkj8n4hvk49nvtbo782/family1/ee433d715588463a907d29f05595247d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/9f2bfaa582724cce8965c3c97cbaac30_SeqId_29_ 2023-11-30 20:55:11,302 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__i9vdnoposuga9ktc9esb6pd57ud0agnuu7b53o6v0g5sn9csm54dg8q30s5qet3t/family1/356700fc03d9463287c023af81e8c87a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/dd7d977101364cd5b711477fc3e132b7_SeqId_29_ 2023-11-30 20:55:11,302 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__nbjqo8bemlh940j35r7sge7jqdu89osgvvtntjf5ba141ecjo0j3oo9p5vk094it/family1/73f26311125c4d38bd0b759db8bdd42a into 01ed825bd99347cac3dd87faa7414ea1/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/2b3c1b31184648b7af55dca07d2c6681_SeqId_29_ - updating store file list. 2023-11-30 20:55:11,302 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__9vejrr8g0rncrgb05ttgc8tmafo7434hg6s5i16r5dv4glkj8n4hvk49nvtbo782/family1/ee433d715588463a907d29f05595247d into 0ea9609bce6110fb1313e1d0e5a83ef8/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/9f2bfaa582724cce8965c3c97cbaac30_SeqId_29_ - updating store file list. 2023-11-30 20:55:11,302 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__i9vdnoposuga9ktc9esb6pd57ud0agnuu7b53o6v0g5sn9csm54dg8q30s5qet3t/family1/356700fc03d9463287c023af81e8c87a into 403bb60689734a0b812ff8d53e9885e9/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/dd7d977101364cd5b711477fc3e132b7_SeqId_29_ - updating store file list. 2023-11-30 20:55:11,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/2b3c1b31184648b7af55dca07d2c6681_SeqId_29_ into 01ed825bd99347cac3dd87faa7414ea1/family1 2023-11-30 20:55:11,306 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__nbjqo8bemlh940j35r7sge7jqdu89osgvvtntjf5ba141ecjo0j3oo9p5vk094it/family1/73f26311125c4d38bd0b759db8bdd42a into 01ed825bd99347cac3dd87faa7414ea1/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/2b3c1b31184648b7af55dca07d2c6681_SeqId_29_) 2023-11-30 20:55:11,306 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/9f2bfaa582724cce8965c3c97cbaac30_SeqId_29_ into 0ea9609bce6110fb1313e1d0e5a83ef8/family1 2023-11-30 20:55:11,307 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__9vejrr8g0rncrgb05ttgc8tmafo7434hg6s5i16r5dv4glkj8n4hvk49nvtbo782/family1/ee433d715588463a907d29f05595247d into 0ea9609bce6110fb1313e1d0e5a83ef8/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/9f2bfaa582724cce8965c3c97cbaac30_SeqId_29_) 2023-11-30 20:55:11,307 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/dd7d977101364cd5b711477fc3e132b7_SeqId_29_ into 403bb60689734a0b812ff8d53e9885e9/family1 2023-11-30 20:55:11,307 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__i9vdnoposuga9ktc9esb6pd57ud0agnuu7b53o6v0g5sn9csm54dg8q30s5qet3t/family1/356700fc03d9463287c023af81e8c87a into 403bb60689734a0b812ff8d53e9885e9/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/dd7d977101364cd5b711477fc3e132b7_SeqId_29_) 2023-11-30 20:55:11,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__nbjqo8bemlh940j35r7sge7jqdu89osgvvtntjf5ba141ecjo0j3oo9p5vk094it/family1/73f26311125c4d38bd0b759db8bdd42a 2023-11-30 20:55:11,307 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__9vejrr8g0rncrgb05ttgc8tmafo7434hg6s5i16r5dv4glkj8n4hvk49nvtbo782/family1/ee433d715588463a907d29f05595247d 2023-11-30 20:55:11,308 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__i9vdnoposuga9ktc9esb6pd57ud0agnuu7b53o6v0g5sn9csm54dg8q30s5qet3t/family1/356700fc03d9463287c023af81e8c87a 2023-11-30 20:55:11,310 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:11,310 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:11,310 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:11,311 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:11,312 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130b29884754c7d40d6a8b3ba2f50792192 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130b29884754c7d40d6a8b3ba2f50792192 2023-11-30 20:55:11,312 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311306546e5329d774a25a4026a0890c9fa7d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e202311306546e5329d774a25a4026a0890c9fa7d 2023-11-30 20:55:11,313 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130c04d061eea1f4569b29abf5816c2a1ac to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130c04d061eea1f4569b29abf5816c2a1ac 2023-11-30 20:55:11,313 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130c535296bd486440aaac6975a86d23ccc to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130c535296bd486440aaac6975a86d23ccc 2023-11-30 20:55:11,314 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130f35c7885afb540919833db0c12f4e7d3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130f35c7885afb540919833db0c12f4e7d3 2023-11-30 20:55:11,315 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130d1a07191760f4cd999afd0c3861fad14 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130d1a07191760f4cd999afd0c3861fad14 2023-11-30 20:55:11,316 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130fd803205a71d4bd5a1d9d02d6db3ca05 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130fd803205a71d4bd5a1d9d02d6db3ca05 2023-11-30 20:55:11,316 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130fb4e481905394205a5eadaef51c09c81 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130fb4e481905394205a5eadaef51c09c81 2023-11-30 20:55:11,316 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-30 20:55:11,316 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-30 20:55:11,316 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130' 2023-11-30 20:55:11,316 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130' 2023-11-30 20:55:11,317 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:11,317 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:11,321 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:11,322 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:11,323 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113001022efbefb24aaeba59cb60ba4ff004 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113001022efbefb24aaeba59cb60ba4ff004 2023-11-30 20:55:11,324 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130419d6f50892d42b1920e77b28b915552 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130419d6f50892d42b1920e77b28b915552 2023-11-30 20:55:11,325 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113099479eb9ec2a47ccb65c7b64cabde0a2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113099479eb9ec2a47ccb65c7b64cabde0a2 2023-11-30 20:55:11,326 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130ac27f80ec04844ed9b448e4e0290b3cb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130ac27f80ec04844ed9b448e4e0290b3cb 2023-11-30 20:55:11,326 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-30 20:55:11,326 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130' 2023-11-30 20:55:11,327 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:11,327 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:11,327 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:11,327 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130f86251ba666e47889b82d2370c078902_del] 2023-11-30 20:55:11,328 DEBUG [Listener at localhost/34291] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:11,329 DEBUG [Listener at localhost/34291] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130f86251ba666e47889b82d2370c078902_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130f86251ba666e47889b82d2370c078902_del 2023-11-30 20:55:11,329 INFO [Listener at localhost/34291] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-30 20:55:11,329 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130700751d6af824590bf23176023f093d6_del] 2023-11-30 20:55:11,330 DEBUG [Listener at localhost/34291] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:11,331 DEBUG [Listener at localhost/34291] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130700751d6af824590bf23176023f093d6_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b20231130700751d6af824590bf23176023f093d6_del 2023-11-30 20:55:11,331 INFO [Listener at localhost/34291] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-30 20:55:11,331 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113015c44dbf7aad494d89fc3d9fb700b8be_del] 2023-11-30 20:55:11,331 DEBUG [Listener at localhost/34291] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:11,333 DEBUG [Listener at localhost/34291] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113015c44dbf7aad494d89fc3d9fb700b8be_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113015c44dbf7aad494d89fc3d9fb700b8be_del 2023-11-30 20:55:11,333 INFO [Listener at localhost/34291] mob.MobUtils(508): Table testCompactionWithHFileLink 1 expired mob files are deleted 2023-11-30 20:55:11,336 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:11,338 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:11,342 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:11,343 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:11,348 INFO [Listener at localhost/34291] client.HBaseAdmin$15(890): Started disable of testCompactionWithHFileLink 2023-11-30 20:55:11,348 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.HMaster$11(2418): Client=jenkins//172.31.14.131 disable testCompactionWithHFileLink 2023-11-30 20:55:11,349 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=88, state=RUNNABLE:DISABLE_TABLE_PREPARE; DisableTableProcedure table=testCompactionWithHFileLink 2023-11-30 20:55:11,352 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-30 20:55:11,352 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377711352"}]},"ts":"1701377711352"} 2023-11-30 20:55:11,353 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLING in hbase:meta 2023-11-30 20:55:11,355 INFO [PEWorker-1] procedure.DisableTableProcedure(293): Set testCompactionWithHFileLink to state=DISABLING 2023-11-30 20:55:11,356 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, UNASSIGN}, {pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, UNASSIGN}, {pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, UNASSIGN}] 2023-11-30 20:55:11,357 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=91, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, UNASSIGN 2023-11-30 20:55:11,357 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=90, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, UNASSIGN 2023-11-30 20:55:11,357 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=89, ppid=88, state=RUNNABLE:REGION_STATE_TRANSITION_CLOSE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, UNASSIGN 2023-11-30 20:55:11,357 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=01ed825bd99347cac3dd87faa7414ea1, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:11,357 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=0ea9609bce6110fb1313e1d0e5a83ef8, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:11,357 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=403bb60689734a0b812ff8d53e9885e9, regionState=CLOSING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:11,358 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377711357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377711357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377711357"}]},"ts":"1701377711357"} 2023-11-30 20:55:11,358 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377711357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377711357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377711357"}]},"ts":"1701377711357"} 2023-11-30 20:55:11,358 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377711357"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377711357"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377711357"}]},"ts":"1701377711357"} 2023-11-30 20:55:11,359 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=92, ppid=91, state=RUNNABLE; CloseRegionProcedure 01ed825bd99347cac3dd87faa7414ea1, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:11,360 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=93, ppid=89, state=RUNNABLE; CloseRegionProcedure 403bb60689734a0b812ff8d53e9885e9, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:11,361 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=94, ppid=90, state=RUNNABLE; CloseRegionProcedure 0ea9609bce6110fb1313e1d0e5a83ef8, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:11,453 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-30 20:55:11,510 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:11,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:11,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ea9609bce6110fb1313e1d0e5a83ef8, disabling compactions & flushes 2023-11-30 20:55:11,511 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:11,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:11,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. after waiting 0 ms 2023-11-30 20:55:11,511 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:11,516 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-30 20:55:11,517 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:11,517 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:55:11,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:11,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:11,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 403bb60689734a0b812ff8d53e9885e9, disabling compactions & flushes 2023-11-30 20:55:11,519 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:11,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:11,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. after waiting 0 ms 2023-11-30 20:55:11,519 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:11,519 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=90 updating hbase:meta row=0ea9609bce6110fb1313e1d0e5a83ef8, regionState=CLOSED 2023-11-30 20:55:11,519 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377711519"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377711519"}]},"ts":"1701377711519"} 2023-11-30 20:55:11,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=94, resume processing ppid=90 2023-11-30 20:55:11,522 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=94, ppid=90, state=SUCCESS; CloseRegionProcedure 0ea9609bce6110fb1313e1d0e5a83ef8, server=jenkins-hbase4.apache.org,40365,1701377600631 in 161 msec 2023-11-30 20:55:11,523 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-30 20:55:11,524 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:11,524 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=90, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, UNASSIGN in 166 msec 2023-11-30 20:55:11,524 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:55:11,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:11,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(111): Close 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:11,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01ed825bd99347cac3dd87faa7414ea1, disabling compactions & flushes 2023-11-30 20:55:11,525 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:11,525 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:11,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. after waiting 0 ms 2023-11-30 20:55:11,526 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:11,526 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=89 updating hbase:meta row=403bb60689734a0b812ff8d53e9885e9, regionState=CLOSED 2023-11-30 20:55:11,526 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377711526"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377711526"}]},"ts":"1701377711526"} 2023-11-30 20:55:11,528 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=93, resume processing ppid=89 2023-11-30 20:55:11,529 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=93, ppid=89, state=SUCCESS; CloseRegionProcedure 403bb60689734a0b812ff8d53e9885e9, server=jenkins-hbase4.apache.org,40365,1701377600631 in 168 msec 2023-11-30 20:55:11,529 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=89, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, UNASSIGN in 172 msec 2023-11-30 20:55:11,530 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/recovered.edits/31.seqid, newMaxSeqId=31, maxSeqId=1 2023-11-30 20:55:11,531 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:11,531 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:55:11,532 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.UnassignRegionHandler(149): Closed 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:11,532 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=91 updating hbase:meta row=01ed825bd99347cac3dd87faa7414ea1, regionState=CLOSED 2023-11-30 20:55:11,532 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377711532"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377711532"}]},"ts":"1701377711532"} 2023-11-30 20:55:11,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=92, resume processing ppid=91 2023-11-30 20:55:11,534 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=92, ppid=91, state=SUCCESS; CloseRegionProcedure 01ed825bd99347cac3dd87faa7414ea1, server=jenkins-hbase4.apache.org,40365,1701377600631 in 174 msec 2023-11-30 20:55:11,535 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=91, resume processing ppid=88 2023-11-30 20:55:11,536 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=91, ppid=88, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, UNASSIGN in 178 msec 2023-11-30 20:55:11,536 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377711536"}]},"ts":"1701377711536"} 2023-11-30 20:55:11,537 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=DISABLED in hbase:meta 2023-11-30 20:55:11,539 INFO [PEWorker-3] procedure.DisableTableProcedure(305): Set testCompactionWithHFileLink to state=DISABLED 2023-11-30 20:55:11,540 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=88, state=SUCCESS; DisableTableProcedure table=testCompactionWithHFileLink in 190 msec 2023-11-30 20:55:11,654 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=88 2023-11-30 20:55:11,654 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: DISABLE, Table Name: default:testCompactionWithHFileLink, procId: 88 completed 2023-11-30 20:55:11,664 INFO [Listener at localhost/34291] client.HBaseAdmin(2586): Taking restore-failsafe snapshot: hbase-failsafe-snaptb-1701377699633-1701377711664 2023-11-30 20:55:11,665 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1583): Client=jenkins//172.31.14.131 snapshot request for:{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-30 20:55:11,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotDescriptionUtils(316): Creation time not specified, setting to:1701377711665 (current time:1701377711665). 2023-11-30 20:55:11,665 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotDescriptionUtils(332): Snapshot current TTL value: 0 resetting it to default value: 0 2023-11-30 20:55:11,666 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] zookeeper.ReadOnlyZKClient(139): Connect 0x15fc9df7 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:55:11,672 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@78d1589b, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:55:11,673 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:55:11,675 INFO [RS-EventLoopGroup-3-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:42358, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:55:11,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x15fc9df7 to 127.0.0.1:58095 2023-11-30 20:55:11,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:55:11,676 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(637): No existing snapshot, attempting snapshot... 2023-11-30 20:55:11,677 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(695): Table is disabled, running snapshot entirely on master for { ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-30 20:55:11,679 WARN [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(519): Unable to retrieve ACL status for path: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot, current working dir path: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701377699633-1701377711664 org.apache.hadoop.hdfs.protocol.AclException: The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) at java.lang.reflect.Constructor.newInstance(Constructor.java:423) at org.apache.hadoop.ipc.RemoteException.instantiateException(RemoteException.java:121) at org.apache.hadoop.ipc.RemoteException.unwrapRemoteException(RemoteException.java:88) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2736) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2294) at org.apache.hadoop.hdfs.DistributedFileSystem$51.doCall(DistributedFileSystem.java:2291) at org.apache.hadoop.fs.FileSystemLinkResolver.resolve(FileSystemLinkResolver.java:81) at org.apache.hadoop.hdfs.DistributedFileSystem.getAclStatus(DistributedFileSystem.java:2291) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.updateWorkingDirAclsIfRequired(SnapshotManager.java:517) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.prepareToTakeSnapshot(SnapshotManager.java:490) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.snapshotDisabledTable(SnapshotManager.java:541) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshotInternal(SnapshotManager.java:698) at org.apache.hadoop.hbase.master.snapshot.SnapshotManager.takeSnapshot(SnapshotManager.java:623) at org.apache.hadoop.hbase.master.MasterRpcServices.snapshot(MasterRpcServices.java:1588) at org.apache.hadoop.hbase.shaded.protobuf.generated.MasterProtos$MasterService$2.callBlockingMethod(MasterProtos.java) at org.apache.hadoop.hbase.ipc.RpcServer.call(RpcServer.java:387) at org.apache.hadoop.hbase.ipc.CallRunner.run(CallRunner.java:132) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:369) at org.apache.hadoop.hbase.ipc.RpcExecutor$Handler.run(RpcExecutor.java:349) Caused by: org.apache.hadoop.ipc.RemoteException(org.apache.hadoop.hdfs.protocol.AclException): The ACL operation has been rejected. Support for ACLs has been disabled by setting dfs.namenode.acls.enabled to false. at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.checkAclsConfigFlag(FSDirAclOp.java:197) at org.apache.hadoop.hdfs.server.namenode.FSDirAclOp.getAclStatus(FSDirAclOp.java:150) at org.apache.hadoop.hdfs.server.namenode.FSNamesystem.getAclStatus(FSNamesystem.java:6744) at org.apache.hadoop.hdfs.server.namenode.NameNodeRpcServer.getAclStatus(NameNodeRpcServer.java:2065) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolServerSideTranslatorPB.getAclStatus(ClientNamenodeProtocolServerSideTranslatorPB.java:1378) at org.apache.hadoop.hdfs.protocol.proto.ClientNamenodeProtocolProtos$ClientNamenodeProtocol$2.callBlockingMethod(ClientNamenodeProtocolProtos.java) at org.apache.hadoop.ipc.ProtobufRpcEngine$Server$ProtoBufRpcInvoker.call(ProtobufRpcEngine.java:507) at org.apache.hadoop.ipc.RPC$Server.call(RPC.java:1034) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:994) at org.apache.hadoop.ipc.Server$RpcCall.run(Server.java:922) at java.security.AccessController.doPrivileged(Native Method) at javax.security.auth.Subject.doAs(Subject.java:422) at org.apache.hadoop.security.UserGroupInformation.doAs(UserGroupInformation.java:1893) at org.apache.hadoop.ipc.Server$Handler.run(Server.java:2833) at org.apache.hadoop.ipc.Client.getRpcResponse(Client.java:1540) at org.apache.hadoop.ipc.Client.call(Client.java:1486) at org.apache.hadoop.ipc.Client.call(Client.java:1385) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:232) at org.apache.hadoop.ipc.ProtobufRpcEngine$Invoker.invoke(ProtobufRpcEngine.java:118) at com.sun.proxy.$Proxy29.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.protocolPB.ClientNamenodeProtocolTranslatorPB.getAclStatus(ClientNamenodeProtocolTranslatorPB.java:1385) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.io.retry.RetryInvocationHandler.invokeMethod(RetryInvocationHandler.java:422) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeMethod(RetryInvocationHandler.java:165) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invoke(RetryInvocationHandler.java:157) at org.apache.hadoop.io.retry.RetryInvocationHandler$Call.invokeOnce(RetryInvocationHandler.java:95) at org.apache.hadoop.io.retry.RetryInvocationHandler.invoke(RetryInvocationHandler.java:359) at com.sun.proxy.$Proxy30.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.lang.reflect.Method.invoke(Method.java:498) at org.apache.hadoop.hbase.fs.HFileSystem$1.invoke(HFileSystem.java:361) at com.sun.proxy.$Proxy33.getAclStatus(Unknown Source) at org.apache.hadoop.hdfs.DFSClient.getAclStatus(DFSClient.java:2734) ... 15 more 2023-11-30 20:55:11,681 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-30 20:55:11,682 DEBUG [PEWorker-1] locking.LockProcedure(309): LOCKED pid=95, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-30 20:55:11,683 INFO [PEWorker-1] procedure2.TimeoutExecutorThread(81): ADDED pid=95, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE; timeout=600000, timestamp=1701378311683 2023-11-30 20:55:11,683 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(700): Started snapshot: { ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-30 20:55:11,683 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(174): Running DISABLED table snapshot hbase-failsafe-snaptb-1701377699633-1701377711664 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink 2023-11-30 20:55:11,683 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2418): Waiting a max of 300000 ms for snapshot '{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 }'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:11,683 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#1) Sleeping: 100ms while waiting for snapshot completion. 2023-11-30 20:55:11,783 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:55:11,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:55:11,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-30 20:55:11,785 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#2) Sleeping: 200ms while waiting for snapshot completion. 2023-11-30 20:55:11,985 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:55:11,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:55:11,986 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-30 20:55:11,986 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#3) Sleeping: 300ms while waiting for snapshot completion. 2023-11-30 20:55:12,089 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(97): Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=DISABLED ttl=0 } 2023-11-30 20:55:12,091 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-30 20:55:12,091 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-30 20:55:12,091 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-30 20:55:12,091 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(297): Storing region-info for snapshot. 2023-11-30 20:55:12,091 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-30 20:55:12,091 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-30 20:55:12,091 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-30 20:55:12,091 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(302): Creating references for hfiles 2023-11-30 20:55:12,094 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/2b3c1b31184648b7af55dca07d2c6681_SeqId_29_, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/310bd88ae77f435091a5c0e132d8e35d] hfiles 2023-11-30 20:55:12,094 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/2b3c1b31184648b7af55dca07d2c6681_SeqId_29_ 2023-11-30 20:55:12,094 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/310bd88ae77f435091a5c0e132d8e35d 2023-11-30 20:55:12,094 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/03c0bfad65454beaa863f3244776358d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/9f2bfaa582724cce8965c3c97cbaac30_SeqId_29_] hfiles 2023-11-30 20:55:12,094 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/03c0bfad65454beaa863f3244776358d 2023-11-30 20:55:12,094 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/9f2bfaa582724cce8965c3c97cbaac30_SeqId_29_ 2023-11-30 20:55:12,094 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3de9019222f5447382ee660a301dc81a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/dd7d977101364cd5b711477fc3e132b7_SeqId_29_] hfiles 2023-11-30 20:55:12,094 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/2): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3de9019222f5447382ee660a301dc81a 2023-11-30 20:55:12,094 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (2/2): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/dd7d977101364cd5b711477fc3e132b7_SeqId_29_ 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311305e2c1a2718554ea096ddcecabd2bea87, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130445e4b7fa3bd4239ab7a2c7230a4aeaa, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023113039ab5c5a901e438dbeb6516e248680d9] hfiles 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/3): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311305e2c1a2718554ea096ddcecabd2bea87 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/3): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130445e4b7fa3bd4239ab7a2c7230a4aeaa 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/3): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023113039ab5c5a901e438dbeb6516e248680d9 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e66f84aeab2c4aa7a2b1f9070b378a1f] hfiles 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-2] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e66f84aeab2c4aa7a2b1f9070b378a1f 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/5d781a9d48a447fdaf4d714b515a074e] hfiles 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-1] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/5d781a9d48a447fdaf4d714b515a074e 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/c285d850b050482383c23563d2f95452] hfiles 2023-11-30 20:55:12,095 DEBUG [DisabledTableSnapshot-pool-3] snapshot.SnapshotManifest(363): Adding reference for hfile (1/1): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/c285d850b050482383c23563d2f95452 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(355): Adding snapshot references for [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311301538720718a14d9caef1c95204645160, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130356cc59cca7c42069cc083ec0333d407, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113082498e9565f340b8b04ca4c728de3374, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113092aeee01e56e42d2bb94d2c3dd37a87b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130bd163db4497546cd92b653dd076e147f_del, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023113028bd1a85f5ca41ac9ad8a25214e4a2f7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130c0ca3121f8304ded9df2e89ba67783e0, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130ce89dffa6091483fbd6bfaab4cdc7872, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130db234c8c4e0c42b4ac8f9197755c585c_del, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130eb58982bac24436081a40f39c8267e87, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023113035c9d951b6f64285b55a0db2a16e0343, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311306b5bd5973489411b8940f73fc70acf9b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311307b2515f8f40c438e91b612191720e3b9_del, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b39cbc07f6f14bffbbf65ead3ba9e77d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b656ddbe7f094cc5855d89b26fbf0180] hfiles 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (1/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b202311301538720718a14d9caef1c95204645160 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (2/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130356cc59cca7c42069cc083ec0333d407 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (3/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113082498e9565f340b8b04ca4c728de3374 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (4/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b2023113092aeee01e56e42d2bb94d2c3dd37a87b 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (5/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130bd163db4497546cd92b653dd076e147f_del 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (6/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c2023113028bd1a85f5ca41ac9ad8a25214e4a2f7 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (7/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130c0ca3121f8304ded9df2e89ba67783e0 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (8/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130ce89dffa6091483fbd6bfaab4cdc7872 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (9/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130db234c8c4e0c42b4ac8f9197755c585c_del 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (10/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130eb58982bac24436081a40f39c8267e87 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (11/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e2023113035c9d951b6f64285b55a0db2a16e0343 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (12/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311306b5bd5973489411b8940f73fc70acf9b 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (13/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311307b2515f8f40c438e91b612191720e3b9_del 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (14/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b39cbc07f6f14bffbbf65ead3ba9e77d 2023-11-30 20:55:12,102 DEBUG [DisabledTableSnapshot-pool-0] snapshot.SnapshotManifest(363): Adding reference for hfile (15/15): hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e20231130b656ddbe7f094cc5855d89b26fbf0180 2023-11-30 20:55:12,286 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:55:12,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:55:12,288 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-30 20:55:12,288 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#4) Sleeping: 500ms while waiting for snapshot completion. 2023-11-30 20:55:12,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.DisabledTableSnapshotHandler(120): Marking snapshot{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=DISABLED ttl=0 } as finished. 2023-11-30 20:55:12,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifest(484): Convert to Single Snapshot Manifest for hbase-failsafe-snaptb-1701377699633-1701377711664 2023-11-30 20:55:12,505 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotManifestV1(126): No regions under directory:hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701377699633-1701377711664 2023-11-30 20:55:12,788 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:55:12,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:55:12,789 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(406): Snapshoting '{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' is still in progress! 2023-11-30 20:55:12,790 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2428): (#5) Sleeping: 1000ms while waiting for snapshot completion. 2023-11-30 20:55:12,931 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.SnapshotDescriptionUtils(404): Sentinel is done, just moving the snapshot from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701377699633-1701377711664 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/hbase-failsafe-snaptb-1701377699633-1701377711664 2023-11-30 20:55:12,932 INFO [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(229): Snapshot hbase-failsafe-snaptb-1701377699633-1701377711664 of table testCompactionWithHFileLink completed 2023-11-30 20:55:12,932 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(246): Launching cleanup of working dir:hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701377699633-1701377711664 2023-11-30 20:55:12,933 ERROR [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(251): Couldn't delete snapshot working directory:hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.hbase-snapshot/.tmp/hbase-failsafe-snaptb-1701377699633-1701377711664 2023-11-30 20:55:12,933 DEBUG [MASTER_SNAPSHOT_OPERATIONS-master/jenkins-hbase4:0-0] snapshot.TakeSnapshotHandler(257): Table snapshot journal : Running DISABLED table snapshot hbase-failsafe-snaptb-1701377699633-1701377711664 C_M_SNAPSHOT_TABLE on table testCompactionWithHFileLink at 1701377711683Starting to write region info and WALs for regions for offline snapshot:{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=DISABLED ttl=0 } at 1701377712089 (+406 ms)Consolidate snapshot: hbase-failsafe-snaptb-1701377699633-1701377711664 at 1701377712505 (+416 ms)Loading Region manifests for hbase-failsafe-snaptb-1701377699633-1701377711664 at 1701377712505Writing data manifest for hbase-failsafe-snaptb-1701377699633-1701377711664 at 1701377712508 (+3 ms)Verifying snapshot: hbase-failsafe-snaptb-1701377699633-1701377711664 at 1701377712914 (+406 ms)Snapshot hbase-failsafe-snaptb-1701377699633-1701377711664 of table testCompactionWithHFileLink completed at 1701377712932 (+18 ms) 2023-11-30 20:55:12,933 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=95, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE 2023-11-30 20:55:12,935 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=95, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testCompactionWithHFileLink, type=EXCLUSIVE in 1.2530 sec 2023-11-30 20:55:13,790 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2434): Getting current status of snapshot from master... 2023-11-30 20:55:13,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1212): Checking to see if snapshot from request:{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 } is done 2023-11-30 20:55:13,791 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(403): Snapshot '{ ss=hbase-failsafe-snaptb-1701377699633-1701377711664 table=testCompactionWithHFileLink type=FLUSH ttl=0 }' has completed, notifying client. 2023-11-30 20:55:13,832 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=96, state=RUNNABLE:RESTORE_SNAPSHOT_PRE_OPERATION; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1701377699633" table: "testCompactionWithHFileLink" creation_time: 1701377699643 type: FLUSH version: 2 ttl: 0 ) 2023-11-30 20:55:13,833 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(916): Restore snapshot=snaptb-1701377699633 as table=testCompactionWithHFileLink 2023-11-30 20:55:13,836 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-30 20:55:13,937 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-30 20:55:14,138 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-30 20:55:14,244 DEBUG [PEWorker-5] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-30 20:55:14,245 DEBUG [PEWorker-5] util.FSTableDescriptors(519): Deleted hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000001 2023-11-30 20:55:14,245 INFO [PEWorker-5] util.FSTableDescriptors(293): Updated tableinfo=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/.tabledesc/.tableinfo.0000000002 2023-11-30 20:55:14,246 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(384): Starting restore snapshot={ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } 2023-11-30 20:55:14,252 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(177): starting restore table regions using snapshot=name: "snaptb-1701377699633" table: "testCompactionWithHFileLink" creation_time: 1701377699643 type: FLUSH version: 2 ttl: 0 2023-11-30 20:55:14,252 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(785): get table regions: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink 2023-11-30 20:55:14,258 DEBUG [PEWorker-5] snapshot.RestoreSnapshotHelper(797): found 3 regions for table=testCompactionWithHFileLink 2023-11-30 20:55:14,261 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130445e4b7fa3bd4239ab7a2c7230a4aeaa to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c20231130445e4b7fa3bd4239ab7a2c7230a4aeaa 2023-11-30 20:55:14,263 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023113039ab5c5a901e438dbeb6516e248680d9 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e2023113039ab5c5a901e438dbeb6516e248680d9 2023-11-30 20:55:14,264 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311305e2c1a2718554ea096ddcecabd2bea87 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311305e2c1a2718554ea096ddcecabd2bea87 2023-11-30 20:55:14,264 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231130b29884754c7d40d6a8b3ba2f50792192 of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,267 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231130c04d061eea1f4569b29abf5816c2a1ac of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,271 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231130f35c7885afb540919833db0c12f4e7d3 of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,274 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c4ca4238a0b923820dcc509a6f75849b20231130fd803205a71d4bd5a1d9d02d6db3ca05 of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,277 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023113001022efbefb24aaeba59cb60ba4ff004 of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,280 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231130419d6f50892d42b1920e77b28b915552 of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,284 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c2023113099479eb9ec2a47ccb65c7b64cabde0a2 of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,287 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink c81e728d9d4c2f636f067f89cc14862c20231130ac27f80ec04844ed9b448e4e0290b3cb of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,290 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e202311306546e5329d774a25a4026a0890c9fa7d of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,293 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231130c535296bd486440aaac6975a86d23ccc of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,296 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231130d1a07191760f4cd999afd0c3861fad14 of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,299 DEBUG [RestoreSnapshot-pool-0] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d41d8cd98f00b204e9800998ecf8427e20231130fb4e481905394205a5eadaef51c09c81 of snapshot=snaptb-1701377699633 to region=0e7b6fa9e81bd62588edd7d77d6165e4 table=testCompactionWithHFileLink 2023-11-30 20:55:14,304 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311307b2515f8f40c438e91b612191720e3b9_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/d41d8cd98f00b204e9800998ecf8427e202311307b2515f8f40c438e91b612191720e3b9_del 2023-11-30 20:55:14,305 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130db234c8c4e0c42b4ac8f9197755c585c_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c81e728d9d4c2f636f067f89cc14862c20231130db234c8c4e0c42b4ac8f9197755c585c_del 2023-11-30 20:55:14,306 DEBUG [RestoreSnapshot-pool-0] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130bd163db4497546cd92b653dd076e147f_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family2/c4ca4238a0b923820dcc509a6f75849b20231130bd163db4497546cd92b653dd076e147f_del 2023-11-30 20:55:14,306 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:14,306 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:14,306 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(223): region to restore: 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:14,310 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/2b3c1b31184648b7af55dca07d2c6681_SeqId_29_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/2b3c1b31184648b7af55dca07d2c6681_SeqId_29_ 2023-11-30 20:55:14,310 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3de9019222f5447382ee660a301dc81a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/3de9019222f5447382ee660a301dc81a 2023-11-30 20:55:14,310 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/03c0bfad65454beaa863f3244776358d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/03c0bfad65454beaa863f3244776358d 2023-11-30 20:55:14,312 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/310bd88ae77f435091a5c0e132d8e35d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/310bd88ae77f435091a5c0e132d8e35d 2023-11-30 20:55:14,312 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 32079abba267402ca1735206f791b4d0 of snapshot=snaptb-1701377699633 to region=01ed825bd99347cac3dd87faa7414ea1 table=testCompactionWithHFileLink 2023-11-30 20:55:14,312 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/dd7d977101364cd5b711477fc3e132b7_SeqId_29_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/dd7d977101364cd5b711477fc3e132b7_SeqId_29_ 2023-11-30 20:55:14,312 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink fee583d8b3f1490381d50bacf3ef068a of snapshot=snaptb-1701377699633 to region=403bb60689734a0b812ff8d53e9885e9 table=testCompactionWithHFileLink 2023-11-30 20:55:14,312 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/9f2bfaa582724cce8965c3c97cbaac30_SeqId_29_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/9f2bfaa582724cce8965c3c97cbaac30_SeqId_29_ 2023-11-30 20:55:14,312 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 4b3fabc0db2445ba9659532eb7b22739 of snapshot=snaptb-1701377699633 to region=0ea9609bce6110fb1313e1d0e5a83ef8 table=testCompactionWithHFileLink 2023-11-30 20:55:14,317 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 83820ba9973a44c8b9790d7f023c01cd of snapshot=snaptb-1701377699633 to region=403bb60689734a0b812ff8d53e9885e9 table=testCompactionWithHFileLink 2023-11-30 20:55:14,317 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d0696ac8f1d348f392bf7161d1a74257 of snapshot=snaptb-1701377699633 to region=01ed825bd99347cac3dd87faa7414ea1 table=testCompactionWithHFileLink 2023-11-30 20:55:14,318 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 5328d89ed9df4868ab7db70d09635356 of snapshot=snaptb-1701377699633 to region=0ea9609bce6110fb1313e1d0e5a83ef8 table=testCompactionWithHFileLink 2023-11-30 20:55:14,322 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 9c69ecd96ca848018737b813febb37b8 of snapshot=snaptb-1701377699633 to region=403bb60689734a0b812ff8d53e9885e9 table=testCompactionWithHFileLink 2023-11-30 20:55:14,322 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 8f361c5604b9491c91c549db6a9719c1 of snapshot=snaptb-1701377699633 to region=01ed825bd99347cac3dd87faa7414ea1 table=testCompactionWithHFileLink 2023-11-30 20:55:14,322 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f83b3fbd38734f6cada2e54c90a538a7 of snapshot=snaptb-1701377699633 to region=0ea9609bce6110fb1313e1d0e5a83ef8 table=testCompactionWithHFileLink 2023-11-30 20:55:14,327 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink d5fc256bca694ca189a88e74cf1d51b4 of snapshot=snaptb-1701377699633 to region=403bb60689734a0b812ff8d53e9885e9 table=testCompactionWithHFileLink 2023-11-30 20:55:14,328 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f4dface6e29b4f4284e3983996f2ad4d of snapshot=snaptb-1701377699633 to region=01ed825bd99347cac3dd87faa7414ea1 table=testCompactionWithHFileLink 2023-11-30 20:55:14,328 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink a2f784fc39944e75944ea0381694de0b of snapshot=snaptb-1701377699633 to region=0ea9609bce6110fb1313e1d0e5a83ef8 table=testCompactionWithHFileLink 2023-11-30 20:55:14,333 DEBUG [RestoreSnapshot-pool-3] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/c285d850b050482383c23563d2f95452 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/c285d850b050482383c23563d2f95452 2023-11-30 20:55:14,333 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 7448739e94b141f9b706058e32b1442b of snapshot=snaptb-1701377699633 to region=403bb60689734a0b812ff8d53e9885e9 table=testCompactionWithHFileLink 2023-11-30 20:55:14,334 DEBUG [RestoreSnapshot-pool-1] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e66f84aeab2c4aa7a2b1f9070b378a1f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/e66f84aeab2c4aa7a2b1f9070b378a1f 2023-11-30 20:55:14,334 DEBUG [RestoreSnapshot-pool-2] backup.HFileArchiver(582): Archived from FileablePath, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/5d781a9d48a447fdaf4d714b515a074e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/5d781a9d48a447fdaf4d714b515a074e 2023-11-30 20:55:14,334 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e83d4ccfd77343d8a98ce1000f42c3ff of snapshot=snaptb-1701377699633 to region=01ed825bd99347cac3dd87faa7414ea1 table=testCompactionWithHFileLink 2023-11-30 20:55:14,334 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 446b7f31db84408bbf483a130fd5972b of snapshot=snaptb-1701377699633 to region=0ea9609bce6110fb1313e1d0e5a83ef8 table=testCompactionWithHFileLink 2023-11-30 20:55:14,338 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 27af4c497e904fd7a7d12d04be5a6357 of snapshot=snaptb-1701377699633 to region=403bb60689734a0b812ff8d53e9885e9 table=testCompactionWithHFileLink 2023-11-30 20:55:14,339 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 477ebe4cf30745e58dfa03633401f81c of snapshot=snaptb-1701377699633 to region=01ed825bd99347cac3dd87faa7414ea1 table=testCompactionWithHFileLink 2023-11-30 20:55:14,342 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 3ca96eebd6354289b72f4761476dde1b of snapshot=snaptb-1701377699633 to region=403bb60689734a0b812ff8d53e9885e9 table=testCompactionWithHFileLink 2023-11-30 20:55:14,342 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink eee1098d6ca049ac9caca067a04706b8 of snapshot=snaptb-1701377699633 to region=01ed825bd99347cac3dd87faa7414ea1 table=testCompactionWithHFileLink 2023-11-30 20:55:14,346 DEBUG [RestoreSnapshot-pool-3] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 91ed6412283d4c489156efa3d7a4837c of snapshot=snaptb-1701377699633 to region=403bb60689734a0b812ff8d53e9885e9 table=testCompactionWithHFileLink 2023-11-30 20:55:14,346 DEBUG [RestoreSnapshot-pool-1] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink 931cd85217e845a5bd300146bdc5d24b of snapshot=snaptb-1701377699633 to region=01ed825bd99347cac3dd87faa7414ea1 table=testCompactionWithHFileLink 2023-11-30 20:55:14,351 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink f7c7c680c4d34784a21436eef5c564ed of snapshot=snaptb-1701377699633 to region=0ea9609bce6110fb1313e1d0e5a83ef8 table=testCompactionWithHFileLink 2023-11-30 20:55:14,354 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink b6dc491483184d198d4d54fffd425394 of snapshot=snaptb-1701377699633 to region=0ea9609bce6110fb1313e1d0e5a83ef8 table=testCompactionWithHFileLink 2023-11-30 20:55:14,357 DEBUG [RestoreSnapshot-pool-2] snapshot.RestoreSnapshotHelper(517): Restoring missing HFileLink e0eecfe010694b6b87674eefa37ce9cf of snapshot=snaptb-1701377699633 to region=0ea9609bce6110fb1313e1d0e5a83ef8 table=testCompactionWithHFileLink 2023-11-30 20:55:14,367 INFO [PEWorker-5] snapshot.RestoreSnapshotHelper(266): finishing restore table regions using snapshot=name: "snaptb-1701377699633" table: "testCompactionWithHFileLink" creation_time: 1701377699643 type: FLUSH version: 2 ttl: 0 2023-11-30 20:55:14,369 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701377714368"}]},"ts":"9223372036854775807"} 2023-11-30 20:55:14,369 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701377714368"}]},"ts":"9223372036854775807"} 2023-11-30 20:55:14,369 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Delete {"totalColumns":1,"row":"testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.","families":{"info":[{"qualifier":"","vlen":0,"tag":[],"timestamp":"1701377714368"}]},"ts":"9223372036854775807"} 2023-11-30 20:55:14,370 INFO [PEWorker-5] hbase.MetaTableAccessor(1788): Deleted 3 regions from META 2023-11-30 20:55:14,370 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1789): Deleted regions: [{ENCODED => 01ed825bd99347cac3dd87faa7414ea1, NAME => 'testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 0ea9609bce6110fb1313e1d0e5a83ef8, NAME => 'testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 403bb60689734a0b812ff8d53e9885e9, NAME => 'testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.', STARTKEY => '', ENDKEY => '1'}] 2023-11-30 20:55:14,371 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377714369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377714369"}]},"ts":"1701377714369"} 2023-11-30 20:55:14,371 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377714369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377714369"}]},"ts":"1701377714369"} 2023-11-30 20:55:14,371 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377714369"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377714369"}]},"ts":"1701377714369"} 2023-11-30 20:55:14,372 INFO [PEWorker-5] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-30 20:55:14,372 INFO [PEWorker-5] hbase.MetaTableAccessor(1810): Overwritten 3 regions to Meta 2023-11-30 20:55:14,372 DEBUG [PEWorker-5] hbase.MetaTableAccessor(1811): Overwritten regions: [{ENCODED => 01ed825bd99347cac3dd87faa7414ea1, NAME => 'testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.', STARTKEY => '2', ENDKEY => ''}, {ENCODED => 0ea9609bce6110fb1313e1d0e5a83ef8, NAME => 'testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.', STARTKEY => '1', ENDKEY => '2'}, {ENCODED => 403bb60689734a0b812ff8d53e9885e9, NAME => 'testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.', STARTKEY => '', ENDKEY => '1'}] 2023-11-30 20:55:14,373 INFO [PEWorker-5] procedure.RestoreSnapshotProcedure(457): Restore snapshot={ ss=snaptb-1701377699633 table=testCompactionWithHFileLink type=FLUSH ttl=0 } on table=testCompactionWithHFileLink completed! 2023-11-30 20:55:14,375 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=96, state=SUCCESS; RestoreSnapshotProcedure (table=testCompactionWithHFileLink snapshot=name: "snaptb-1701377699633" table: "testCompactionWithHFileLink" creation_time: 1701377699643 type: FLUSH version: 2 ttl: 0 ) in 550 msec 2023-11-30 20:55:14,439 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=96 2023-11-30 20:55:14,440 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: MODIFY, Table Name: default:testCompactionWithHFileLink, procId: 96 completed 2023-11-30 20:55:14,440 INFO [Listener at localhost/34291] client.HBaseAdmin(2618): Deleting restore-failsafe snapshot: hbase-failsafe-snaptb-1701377699633-1701377711664 2023-11-30 20:55:14,444 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(751): Client=jenkins//172.31.14.131 delete name: "hbase-failsafe-snaptb-1701377699633-1701377711664" 2023-11-30 20:55:14,446 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] snapshot.SnapshotManager(335): Deleting snapshot: hbase-failsafe-snaptb-1701377699633-1701377711664 2023-11-30 20:55:14,448 INFO [Listener at localhost/34291] client.HBaseAdmin$14(830): Started enable of testCompactionWithHFileLink 2023-11-30 20:55:14,452 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.HMaster$10(2385): Client=jenkins//172.31.14.131 enable testCompactionWithHFileLink 2023-11-30 20:55:14,458 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=97, state=RUNNABLE:ENABLE_TABLE_PREPARE; EnableTableProcedure table=testCompactionWithHFileLink 2023-11-30 20:55:14,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-30 20:55:14,461 INFO [PEWorker-4] procedure.EnableTableProcedure(296): Attempting to enable the table testCompactionWithHFileLink 2023-11-30 20:55:14,461 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377714461"}]},"ts":"1701377714461"} 2023-11-30 20:55:14,463 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLING in hbase:meta 2023-11-30 20:55:14,465 DEBUG [PEWorker-4] procedure.EnableTableProcedure(107): No change in number of region replicas (configuredReplicaCount=1); assigning. 2023-11-30 20:55:14,465 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, ASSIGN}, {pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, ASSIGN}, {pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, ASSIGN}] 2023-11-30 20:55:14,466 INFO [PEWorker-3] procedure.MasterProcedureScheduler(727): Took xlock for pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, ASSIGN 2023-11-30 20:55:14,466 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, ASSIGN 2023-11-30 20:55:14,466 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, ASSIGN 2023-11-30 20:55:14,467 INFO [PEWorker-3] assignment.TransitRegionStateProcedure(193): Starting pid=100, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-30 20:55:14,467 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=99, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-30 20:55:14,467 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=98, ppid=97, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, ASSIGN; state=CLOSED, location=null; forceNewPlan=false, retain=false 2023-11-30 20:55:14,562 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-30 20:55:14,618 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=01ed825bd99347cac3dd87faa7414ea1, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:14,618 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=0ea9609bce6110fb1313e1d0e5a83ef8, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:14,619 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377714618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377714618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377714618"}]},"ts":"1701377714618"} 2023-11-30 20:55:14,618 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=403bb60689734a0b812ff8d53e9885e9, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:14,619 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377714618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377714618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377714618"}]},"ts":"1701377714618"} 2023-11-30 20:55:14,619 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377714618"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377714618"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377714618"}]},"ts":"1701377714618"} 2023-11-30 20:55:14,620 INFO [PEWorker-5] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=101, ppid=100, state=RUNNABLE; OpenRegionProcedure 01ed825bd99347cac3dd87faa7414ea1, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:14,621 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=102, ppid=99, state=RUNNABLE; OpenRegionProcedure 0ea9609bce6110fb1313e1d0e5a83ef8, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:14,622 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=103, ppid=98, state=RUNNABLE; OpenRegionProcedure 403bb60689734a0b812ff8d53e9885e9, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:14,763 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-30 20:55:14,772 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:14,774 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:14,774 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 01ed825bd99347cac3dd87faa7414ea1, NAME => 'testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.', STARTKEY => '2', ENDKEY => ''} 2023-11-30 20:55:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:14,775 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:14,776 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:14,777 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1 2023-11-30 20:55:14,777 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1 2023-11-30 20:55:14,777 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01ed825bd99347cac3dd87faa7414ea1 columnFamilyName family1 2023-11-30 20:55:14,786 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-32079abba267402ca1735206f791b4d0 2023-11-30 20:55:14,793 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-8f361c5604b9491c91c549db6a9719c1 2023-11-30 20:55:14,798 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-d0696ac8f1d348f392bf7161d1a74257 2023-11-30 20:55:14,805 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-f4dface6e29b4f4284e3983996f2ad4d 2023-11-30 20:55:14,805 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(310): Store=01ed825bd99347cac3dd87faa7414ea1/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:14,805 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:14,806 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2 2023-11-30 20:55:14,806 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2 2023-11-30 20:55:14,807 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 01ed825bd99347cac3dd87faa7414ea1 columnFamilyName family2 2023-11-30 20:55:14,813 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-477ebe4cf30745e58dfa03633401f81c 2023-11-30 20:55:14,817 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-931cd85217e845a5bd300146bdc5d24b 2023-11-30 20:55:14,823 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-e83d4ccfd77343d8a98ce1000f42c3ff 2023-11-30 20:55:14,828 DEBUG [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-eee1098d6ca049ac9caca067a04706b8 2023-11-30 20:55:14,828 INFO [StoreOpener-01ed825bd99347cac3dd87faa7414ea1-1] regionserver.HStore(310): Store=01ed825bd99347cac3dd87faa7414ea1/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:14,829 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:14,830 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:14,831 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:55:14,832 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:55:14,833 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 01ed825bd99347cac3dd87faa7414ea1; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=59469177, jitterRate=-0.11384020745754242}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:55:14,833 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:55:14,834 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1., pid=101, masterSystemTime=1701377714772 2023-11-30 20:55:14,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:55:14,834 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-30 20:55:14,834 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-30 20:55:14,834 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-30 20:55:14,836 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:14,836 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:14,837 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:14,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 0ea9609bce6110fb1313e1d0e5a83ef8, NAME => 'testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.', STARTKEY => '1', ENDKEY => '2'} 2023-11-30 20:55:14,837 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=100 updating hbase:meta row=01ed825bd99347cac3dd87faa7414ea1, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:14,837 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377714837"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377714837"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377714837"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377714837"}]},"ts":"1701377714837"} 2023-11-30 20:55:14,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:14,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:14,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:14,837 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:14,839 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:14,840 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 22152 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-30 20:55:14,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=101, resume processing ppid=100 2023-11-30 20:55:14,840 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1912): 01ed825bd99347cac3dd87faa7414ea1/family1 is initiating minor compaction (all files) 2023-11-30 20:55:14,840 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=101, ppid=100, state=SUCCESS; OpenRegionProcedure 01ed825bd99347cac3dd87faa7414ea1, server=jenkins-hbase4.apache.org,40365,1701377600631 in 218 msec 2023-11-30 20:55:14,840 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 01ed825bd99347cac3dd87faa7414ea1/family1 in testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:14,840 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-30 20:55:14,840 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1 2023-11-30 20:55:14,840 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HStore(1912): 01ed825bd99347cac3dd87faa7414ea1/family2 is initiating minor compaction (all files) 2023-11-30 20:55:14,840 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-32079abba267402ca1735206f791b4d0, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-d0696ac8f1d348f392bf7161d1a74257, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-8f361c5604b9491c91c549db6a9719c1, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-f4dface6e29b4f4284e3983996f2ad4d] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp, totalSize=21.6 K 2023-11-30 20:55:14,840 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 01ed825bd99347cac3dd87faa7414ea1/family2 in testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:55:14,840 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-e83d4ccfd77343d8a98ce1000f42c3ff, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-477ebe4cf30745e58dfa03633401f81c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-eee1098d6ca049ac9caca067a04706b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-931cd85217e845a5bd300146bdc5d24b] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp, totalSize=20.4 K 2023-11-30 20:55:14,840 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1 2023-11-30 20:55:14,841 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ea9609bce6110fb1313e1d0e5a83ef8 columnFamilyName family1 2023-11-30 20:55:14,842 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-32079abba267402ca1735206f791b4d0, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694412 2023-11-30 20:55:14,842 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-e83d4ccfd77343d8a98ce1000f42c3ff, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694412 2023-11-30 20:55:14,843 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-d0696ac8f1d348f392bf7161d1a74257, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695797 2023-11-30 20:55:14,843 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-477ebe4cf30745e58dfa03633401f81c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695797 2023-11-30 20:55:14,844 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-8f361c5604b9491c91c549db6a9719c1, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697214 2023-11-30 20:55:14,844 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-eee1098d6ca049ac9caca067a04706b8, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697214 2023-11-30 20:55:14,844 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-f4dface6e29b4f4284e3983996f2ad4d, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:14,845 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-931cd85217e845a5bd300146bdc5d24b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:14,849 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=100, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=01ed825bd99347cac3dd87faa7414ea1, ASSIGN in 375 msec 2023-11-30 20:55:14,857 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-4b3fabc0db2445ba9659532eb7b22739 2023-11-30 20:55:14,869 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-5328d89ed9df4868ab7db70d09635356 2023-11-30 20:55:14,889 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-a2f784fc39944e75944ea0381694de0b 2023-11-30 20:55:14,892 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 01ed825bd99347cac3dd87faa7414ea1#family1#compaction#114 average throughput is 0.39 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:55:14,903 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f83b3fbd38734f6cada2e54c90a538a7 2023-11-30 20:55:14,907 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(310): Store=0ea9609bce6110fb1313e1d0e5a83ef8/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:14,907 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] throttle.PressureAwareThroughputController(145): 01ed825bd99347cac3dd87faa7414ea1#family2#compaction#115 average throughput is 0.11 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:55:14,908 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:14,909 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2 2023-11-30 20:55:14,909 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2 2023-11-30 20:55:14,909 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 0ea9609bce6110fb1313e1d0e5a83ef8 columnFamilyName family2 2023-11-30 20:55:14,923 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-446b7f31db84408bbf483a130fd5972b 2023-11-30 20:55:14,928 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-b6dc491483184d198d4d54fffd425394 2023-11-30 20:55:14,933 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-e0eecfe010694b6b87674eefa37ce9cf 2023-11-30 20:55:14,937 DEBUG [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f7c7c680c4d34784a21436eef5c564ed 2023-11-30 20:55:14,937 INFO [StoreOpener-0ea9609bce6110fb1313e1d0e5a83ef8-1] regionserver.HStore(310): Store=0ea9609bce6110fb1313e1d0e5a83ef8/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:14,938 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:14,939 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:14,940 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:55:14,941 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:55:14,942 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 0ea9609bce6110fb1313e1d0e5a83ef8; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75245594, jitterRate=0.12124672532081604}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:55:14,942 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:55:14,943 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8., pid=102, masterSystemTime=1701377714772 2023-11-30 20:55:14,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=1), splitQueue=0 2023-11-30 20:55:14,943 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-30 20:55:14,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:14,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:14,944 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:14,944 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 403bb60689734a0b812ff8d53e9885e9, NAME => 'testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.', STARTKEY => '', ENDKEY => '1'} 2023-11-30 20:55:14,945 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=99 updating hbase:meta row=0ea9609bce6110fb1313e1d0e5a83ef8, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:14,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testCompactionWithHFileLink 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:14,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:14,945 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377714944"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377714944"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377714944"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377714944"}]},"ts":"1701377714944"} 2023-11-30 20:55:14,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:14,945 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:14,946 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:14,946 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1 2023-11-30 20:55:14,947 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1 2023-11-30 20:55:14,947 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 403bb60689734a0b812ff8d53e9885e9 columnFamilyName family1 2023-11-30 20:55:14,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=102, resume processing ppid=99 2023-11-30 20:55:14,947 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=102, ppid=99, state=SUCCESS; OpenRegionProcedure 0ea9609bce6110fb1313e1d0e5a83ef8, server=jenkins-hbase4.apache.org,40365,1701377600631 in 325 msec 2023-11-30 20:55:14,948 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=99, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=0ea9609bce6110fb1313e1d0e5a83ef8, ASSIGN in 482 msec 2023-11-30 20:55:14,956 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-83820ba9973a44c8b9790d7f023c01cd 2023-11-30 20:55:14,961 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-9c69ecd96ca848018737b813febb37b8 2023-11-30 20:55:14,969 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-d5fc256bca694ca189a88e74cf1d51b4 2023-11-30 20:55:14,975 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-fee583d8b3f1490381d50bacf3ef068a 2023-11-30 20:55:14,975 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(310): Store=403bb60689734a0b812ff8d53e9885e9/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:14,975 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:14,976 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2 2023-11-30 20:55:14,976 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2 2023-11-30 20:55:14,977 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 403bb60689734a0b812ff8d53e9885e9 columnFamilyName family2 2023-11-30 20:55:14,988 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-27af4c497e904fd7a7d12d04be5a6357 2023-11-30 20:55:14,994 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-3ca96eebd6354289b72f4761476dde1b 2023-11-30 20:55:15,000 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-7448739e94b141f9b706058e32b1442b 2023-11-30 20:55:15,007 DEBUG [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(539): loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-91ed6412283d4c489156efa3d7a4837c 2023-11-30 20:55:15,008 INFO [StoreOpener-403bb60689734a0b812ff8d53e9885e9-1] regionserver.HStore(310): Store=403bb60689734a0b812ff8d53e9885e9/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:15,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:15,009 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:15,011 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testCompactionWithHFileLink descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:55:15,012 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:55:15,013 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 403bb60689734a0b812ff8d53e9885e9; next sequenceid=32; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=75166034, jitterRate=0.12006118893623352}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:55:15,013 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:55:15,014 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9., pid=103, masterSystemTime=1701377714772 2023-11-30 20:55:15,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-30 20:55:15,014 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.CompactSplit(385): Small Compaction requested: system; Because: Opening Region; compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-30 20:55:15,015 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:15,015 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:15,016 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=98 updating hbase:meta row=403bb60689734a0b812ff8d53e9885e9, regionState=OPEN, openSeqNum=32, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:15,016 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9.","families":{"info":[{"qualifier":"regioninfo","vlen":62,"tag":[],"timestamp":"1701377715016"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377715016"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377715016"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377715016"}]},"ts":"1701377715016"} 2023-11-30 20:55:15,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=103, resume processing ppid=98 2023-11-30 20:55:15,019 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=103, ppid=98, state=SUCCESS; OpenRegionProcedure 403bb60689734a0b812ff8d53e9885e9, server=jenkins-hbase4.apache.org,40365,1701377600631 in 396 msec 2023-11-30 20:55:15,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=98, resume processing ppid=97 2023-11-30 20:55:15,020 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=98, ppid=97, state=SUCCESS; TransitRegionStateProcedure table=testCompactionWithHFileLink, region=403bb60689734a0b812ff8d53e9885e9, ASSIGN in 554 msec 2023-11-30 20:55:15,021 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testCompactionWithHFileLink","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377715021"}]},"ts":"1701377715021"} 2023-11-30 20:55:15,022 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testCompactionWithHFileLink, state=ENABLED in hbase:meta 2023-11-30 20:55:15,023 INFO [PEWorker-1] procedure.EnableTableProcedure(310): Table 'testCompactionWithHFileLink' was successfully enabled. 2023-11-30 20:55:15,025 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=97, state=SUCCESS; EnableTableProcedure table=testCompactionWithHFileLink in 571 msec 2023-11-30 20:55:15,064 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=97 2023-11-30 20:55:15,065 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: ENABLE, Table Name: default:testCompactionWithHFileLink, procId: 97 completed 2023-11-30 20:55:15,080 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:15,091 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:15,100 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:15,101 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:15,107 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-30 20:55:15,120 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 12 selected files, and 0 irrelevant files table 'testCompactionWithHFileLink' and column 'family1' 2023-11-30 20:55:15,120 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:15,121 DEBUG [Listener at localhost/34291] zookeeper.ReadOnlyZKClient(139): Connect 0x14921606 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:55:15,127 DEBUG [Listener at localhost/34291] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@29bf87a, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:55:15,127 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:15,127 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:15,127 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:15,219 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130f28cebb8407a40cf9939ffbfcfd61685 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/d41d8cd98f00b204e9800998ecf8427e20231130f28cebb8407a40cf9939ffbfcfd61685 2023-11-30 20:55:15,219 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:15,232 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:55:15,235 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43188, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:55:15,246 DEBUG [MobFileCompactionChore-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:55:15,249 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:51872, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:55:15,262 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130/family1/19fa196db6fe4da1b104b59e25fb197d first=Optional[0\x00\x00\x00\x00] last=Optional[0\x00\x00\x00\x07] 2023-11-30 20:55:15,263 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=32 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130/family1/19fa196db6fe4da1b104b59e25fb197d}] 2023-11-30 20:55:15,269 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130/family1/19fa196db6fe4da1b104b59e25fb197d for inclusion in 403bb60689734a0b812ff8d53e9885e9/family1 2023-11-30 20:55:15,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x00 last=0\x00\x00\x00\x07 2023-11-30 20:55:15,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last=1 2023-11-30 20:55:15,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:55:15,272 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130/family1/19fa196db6fe4da1b104b59e25fb197d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__ljdtsvhjmtfbtl78ftju3ft4prtp96n6la4ld0tqhqgec6t70umj78i873t34is9/family1/19fa196db6fe4da1b104b59e25fb197d 2023-11-30 20:55:15,274 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__ljdtsvhjmtfbtl78ftju3ft4prtp96n6la4ld0tqhqgec6t70umj78i873t34is9/family1/19fa196db6fe4da1b104b59e25fb197d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/4a2f5f299ca74e18b61eebc1b8e6c210_SeqId_34_ 2023-11-30 20:55:15,274 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__ljdtsvhjmtfbtl78ftju3ft4prtp96n6la4ld0tqhqgec6t70umj78i873t34is9/family1/19fa196db6fe4da1b104b59e25fb197d into 403bb60689734a0b812ff8d53e9885e9/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/4a2f5f299ca74e18b61eebc1b8e6c210_SeqId_34_ - updating store file list. 2023-11-30 20:55:15,278 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/4a2f5f299ca74e18b61eebc1b8e6c210_SeqId_34_ into 403bb60689734a0b812ff8d53e9885e9/family1 2023-11-30 20:55:15,278 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__ljdtsvhjmtfbtl78ftju3ft4prtp96n6la4ld0tqhqgec6t70umj78i873t34is9/family1/19fa196db6fe4da1b104b59e25fb197d into 403bb60689734a0b812ff8d53e9885e9/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/4a2f5f299ca74e18b61eebc1b8e6c210_SeqId_34_) 2023-11-30 20:55:15,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__ljdtsvhjmtfbtl78ftju3ft4prtp96n6la4ld0tqhqgec6t70umj78i873t34is9/family1/19fa196db6fe4da1b104b59e25fb197d 2023-11-30 20:55:15,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:15,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-30 20:55:15,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(1912): 403bb60689734a0b812ff8d53e9885e9/family1 is initiating minor compaction (all files) 2023-11-30 20:55:15,281 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@5cb865ce; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-30 20:55:15,283 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:15,284 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:15,285 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311306546e5329d774a25a4026a0890c9fa7d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e202311306546e5329d774a25a4026a0890c9fa7d 2023-11-30 20:55:15,286 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231130c535296bd486440aaac6975a86d23ccc to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231130c535296bd486440aaac6975a86d23ccc 2023-11-30 20:55:15,287 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231130d1a07191760f4cd999afd0c3861fad14 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231130d1a07191760f4cd999afd0c3861fad14 2023-11-30 20:55:15,288 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231130fb4e481905394205a5eadaef51c09c81 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-d41d8cd98f00b204e9800998ecf8427e20231130fb4e481905394205a5eadaef51c09c81 2023-11-30 20:55:15,288 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-30 20:55:15,288 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/d41d8cd98f00b204e9800998ecf8427e20231130' 2023-11-30 20:55:15,288 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:16,023 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113064197adf53374324838612799a47ad98 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c81e728d9d4c2f636f067f89cc14862c2023113064197adf53374324838612799a47ad98 2023-11-30 20:55:16,023 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311300a0dce0fa63b422aa237331e652c09a0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/c4ca4238a0b923820dcc509a6f75849b202311300a0dce0fa63b422aa237331e652c09a0 2023-11-30 20:55:16,024 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:16,024 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:16,055 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130/family1/caa098a914b34041a3bce6a06064804d first=Optional[1\x00\x00\x00\x00] last=Optional[1\x00\x00\x00\x07] 2023-11-30 20:55:16,055 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=32 for row 1 with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130/family1/caa098a914b34041a3bce6a06064804d}] 2023-11-30 20:55:16,056 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130/family1/8f1ad076959c4c939d534bcaf2ea434b first=Optional[2\x00\x00\x00\x00] last=Optional[2\x00\x00\x00\x07] 2023-11-30 20:55:16,056 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=32 for row 2 with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130/family1/8f1ad076959c4c939d534bcaf2ea434b}] 2023-11-30 20:55:16,058 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130/family1/caa098a914b34041a3bce6a06064804d for inclusion in 0ea9609bce6110fb1313e1d0e5a83ef8/family1 2023-11-30 20:55:16,058 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130/family1/8f1ad076959c4c939d534bcaf2ea434b for inclusion in 01ed825bd99347cac3dd87faa7414ea1/family1 2023-11-30 20:55:16,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x00 last=2\x00\x00\x00\x07 2023-11-30 20:55:16,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-30 20:55:16,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:55:16,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x00 last=1\x00\x00\x00\x07 2023-11-30 20:55:16,061 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-30 20:55:16,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:55:16,062 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130/family1/8f1ad076959c4c939d534bcaf2ea434b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__5pej9fte2a1fjapq3cfkkmf1n4qod1g83usd8e6096jenlqj6uc5gm51g5q5isao/family1/8f1ad076959c4c939d534bcaf2ea434b 2023-11-30 20:55:16,063 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130/family1/caa098a914b34041a3bce6a06064804d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__es082hihhuhept959d06q1pokd2373ohe2d8uk2p7dlvu587u3g8cl68luf47tpo/family1/caa098a914b34041a3bce6a06064804d 2023-11-30 20:55:16,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__5pej9fte2a1fjapq3cfkkmf1n4qod1g83usd8e6096jenlqj6uc5gm51g5q5isao/family1/8f1ad076959c4c939d534bcaf2ea434b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/e593832d82414d2ea6a47e4a121763a9_SeqId_34_ 2023-11-30 20:55:16,065 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__es082hihhuhept959d06q1pokd2373ohe2d8uk2p7dlvu587u3g8cl68luf47tpo/family1/caa098a914b34041a3bce6a06064804d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f5a93f88497f4d5f9c23506e37d5c0b3_SeqId_34_ 2023-11-30 20:55:16,066 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__5pej9fte2a1fjapq3cfkkmf1n4qod1g83usd8e6096jenlqj6uc5gm51g5q5isao/family1/8f1ad076959c4c939d534bcaf2ea434b into 01ed825bd99347cac3dd87faa7414ea1/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/e593832d82414d2ea6a47e4a121763a9_SeqId_34_ - updating store file list. 2023-11-30 20:55:16,066 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__es082hihhuhept959d06q1pokd2373ohe2d8uk2p7dlvu587u3g8cl68luf47tpo/family1/caa098a914b34041a3bce6a06064804d into 0ea9609bce6110fb1313e1d0e5a83ef8/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f5a93f88497f4d5f9c23506e37d5c0b3_SeqId_34_ - updating store file list. 2023-11-30 20:55:16,070 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f5a93f88497f4d5f9c23506e37d5c0b3_SeqId_34_ into 0ea9609bce6110fb1313e1d0e5a83ef8/family1 2023-11-30 20:55:16,070 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__es082hihhuhept959d06q1pokd2373ohe2d8uk2p7dlvu587u3g8cl68luf47tpo/family1/caa098a914b34041a3bce6a06064804d into 0ea9609bce6110fb1313e1d0e5a83ef8/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f5a93f88497f4d5f9c23506e37d5c0b3_SeqId_34_) 2023-11-30 20:55:16,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__es082hihhuhept959d06q1pokd2373ohe2d8uk2p7dlvu587u3g8cl68luf47tpo/family1/caa098a914b34041a3bce6a06064804d 2023-11-30 20:55:16,070 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:16,071 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/e593832d82414d2ea6a47e4a121763a9_SeqId_34_ into 01ed825bd99347cac3dd87faa7414ea1/family1 2023-11-30 20:55:16,071 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__5pej9fte2a1fjapq3cfkkmf1n4qod1g83usd8e6096jenlqj6uc5gm51g5q5isao/family1/8f1ad076959c4c939d534bcaf2ea434b into 01ed825bd99347cac3dd87faa7414ea1/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/e593832d82414d2ea6a47e4a121763a9_SeqId_34_) 2023-11-30 20:55:16,071 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testCompactionWithHFileLink__5pej9fte2a1fjapq3cfkkmf1n4qod1g83usd8e6096jenlqj6uc5gm51g5q5isao/family1/8f1ad076959c4c939d534bcaf2ea434b 2023-11-30 20:55:16,073 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:16,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 5 files of size 29606 starting at candidate #0 after considering 6 permutations with 6 in ratio 2023-11-30 20:55:16,074 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:16,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(1912): 0ea9609bce6110fb1313e1d0e5a83ef8/family1 is initiating minor compaction (all files) 2023-11-30 20:55:16,074 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@f591cb8; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-30 20:55:16,076 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231130 table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:16,076 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023113001022efbefb24aaeba59cb60ba4ff004 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023113001022efbefb24aaeba59cb60ba4ff004 2023-11-30 20:55:16,077 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:16,078 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231130419d6f50892d42b1920e77b28b915552 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231130419d6f50892d42b1920e77b28b915552 2023-11-30 20:55:16,079 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231130b29884754c7d40d6a8b3ba2f50792192 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231130b29884754c7d40d6a8b3ba2f50792192 2023-11-30 20:55:16,080 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023113099479eb9ec2a47ccb65c7b64cabde0a2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c2023113099479eb9ec2a47ccb65c7b64cabde0a2 2023-11-30 20:55:16,080 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231130c04d061eea1f4569b29abf5816c2a1ac to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231130c04d061eea1f4569b29abf5816c2a1ac 2023-11-30 20:55:16,081 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231130ac27f80ec04844ed9b448e4e0290b3cb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c81e728d9d4c2f636f067f89cc14862c20231130ac27f80ec04844ed9b448e4e0290b3cb 2023-11-30 20:55:16,081 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-30 20:55:16,081 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c81e728d9d4c2f636f067f89cc14862c20231130' 2023-11-30 20:55:16,082 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:16,082 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231130f35c7885afb540919833db0c12f4e7d3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231130f35c7885afb540919833db0c12f4e7d3 2023-11-30 20:55:16,083 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231130fd803205a71d4bd5a1d9d02d6db3ca05 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0e7b6fa9e81bd62588edd7d77d6165e4/family1/testCompactionWithHFileLink=0e7b6fa9e81bd62588edd7d77d6165e4-c4ca4238a0b923820dcc509a6f75849b20231130fd803205a71d4bd5a1d9d02d6db3ca05 2023-11-30 20:55:16,083 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table testCompactionWithHFileLink 4 expired mob files are deleted 2023-11-30 20:55:16,083 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testCompactionWithHFileLink/c4ca4238a0b923820dcc509a6f75849b20231130' 2023-11-30 20:55:16,084 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231130 for table='testCompactionWithHFileLink' and column='family1' 2023-11-30 20:55:16,084 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testCompactionWithHFileLink' column='family1' 2023-11-30 20:55:16,086 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:16,089 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:16,091 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:16,092 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:16,098 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:16,099 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:16,117 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family1/86b4be7d09b04fd09109cb38b6b5299b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/86b4be7d09b04fd09109cb38b6b5299b 2023-11-30 20:55:16,119 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testCompactionWithHFileLink Thread=292 (was 240) - Thread LEAK? -, OpenFileDescriptor=801 (was 629) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=211 (was 243), ProcessCount=172 (was 172), AvailableMemoryMB=7517 (was 7530) 2023-11-30 20:55:16,124 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 01ed825bd99347cac3dd87faa7414ea1/family1 of 01ed825bd99347cac3dd87faa7414ea1 into 86b4be7d09b04fd09109cb38b6b5299b(size=7.6 K), total size for store is 14.9 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:16,124 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:55:16,124 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1., storeName=01ed825bd99347cac3dd87faa7414ea1/family1, priority=12, startTime=1701377714834; duration=1sec 2023-11-30 20:55:16,125 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=6), splitQueue=0 2023-11-30 20:55:16,125 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 403bb60689734a0b812ff8d53e9885e9/family1 in testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:16,125 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-fee583d8b3f1490381d50bacf3ef068a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-83820ba9973a44c8b9790d7f023c01cd, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-9c69ecd96ca848018737b813febb37b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-d5fc256bca694ca189a88e74cf1d51b4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/4a2f5f299ca74e18b61eebc1b8e6c210_SeqId_34_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp, totalSize=28.9 K 2023-11-30 20:55:16,126 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-fee583d8b3f1490381d50bacf3ef068a, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694409 2023-11-30 20:55:16,126 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-83820ba9973a44c8b9790d7f023c01cd, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695796 2023-11-30 20:55:16,127 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-9c69ecd96ca848018737b813febb37b8, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697213 2023-11-30 20:55:16,127 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/.tmp/family2/32fc379224b44848ad1f8a490120b9fb as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/32fc379224b44848ad1f8a490120b9fb 2023-11-30 20:55:16,128 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-d5fc256bca694ca189a88e74cf1d51b4, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:16,128 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 4a2f5f299ca74e18b61eebc1b8e6c210_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1701377694409 2023-11-30 20:55:16,135 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 01ed825bd99347cac3dd87faa7414ea1/family2 of 01ed825bd99347cac3dd87faa7414ea1 into 32fc379224b44848ad1f8a490120b9fb(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:16,135 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:55:16,135 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1., storeName=01ed825bd99347cac3dd87faa7414ea1/family2, priority=12, startTime=1701377714834; duration=1sec 2023-11-30 20:55:16,135 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=5), splitQueue=0 2023-11-30 20:55:16,135 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 0ea9609bce6110fb1313e1d0e5a83ef8/family1 in testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:16,135 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompaction Thread=291, OpenFileDescriptor=802, MaxFileDescriptor=60000, SystemLoadAverage=211, ProcessCount=172, AvailableMemoryMB=7517 2023-11-30 20:55:16,135 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-4b3fabc0db2445ba9659532eb7b22739, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-5328d89ed9df4868ab7db70d09635356, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f83b3fbd38734f6cada2e54c90a538a7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-a2f784fc39944e75944ea0381694de0b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f5a93f88497f4d5f9c23506e37d5c0b3_SeqId_34_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp, totalSize=28.9 K 2023-11-30 20:55:16,137 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-4b3fabc0db2445ba9659532eb7b22739, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694411 2023-11-30 20:55:16,138 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-5328d89ed9df4868ab7db70d09635356, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695796 2023-11-30 20:55:16,138 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f83b3fbd38734f6cada2e54c90a538a7, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697214 2023-11-30 20:55:16,139 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-a2f784fc39944e75944ea0381694de0b, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:16,140 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting f5a93f88497f4d5f9c23506e37d5c0b3_SeqId_34_, keycount=16, bloomtype=ROW, size=7.3 K, encoding=NONE, compression=NONE, seqNum=35, earliestPutTs=1701377694411 2023-11-30 20:55:16,142 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.HMaster$15(3014): Client=jenkins//172.31.14.131 creating {NAME => 'ns'} 2023-11-30 20:55:16,143 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=104, state=RUNNABLE:CREATE_NAMESPACE_PREPARE; CreateNamespaceProcedure, namespace=ns 2023-11-30 20:55:16,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-30 20:55:16,153 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/namespace 2023-11-30 20:55:16,156 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=104, state=SUCCESS; CreateNamespaceProcedure, namespace=ns in 12 msec 2023-11-30 20:55:16,158 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 403bb60689734a0b812ff8d53e9885e9#family1#compaction#116 average throughput is 0.33 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:55:16,177 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] throttle.PressureAwareThroughputController(145): 0ea9609bce6110fb1313e1d0e5a83ef8#family1#compaction#117 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:55:16,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-32079abba267402ca1735206f791b4d0, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-d0696ac8f1d348f392bf7161d1a74257, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-8f361c5604b9491c91c549db6a9719c1, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-f4dface6e29b4f4284e3983996f2ad4d] to archive 2023-11-30 20:55:16,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:16,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-32079abba267402ca1735206f791b4d0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-32079abba267402ca1735206f791b4d0 2023-11-30 20:55:16,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-d0696ac8f1d348f392bf7161d1a74257 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-d0696ac8f1d348f392bf7161d1a74257 2023-11-30 20:55:16,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-8f361c5604b9491c91c549db6a9719c1 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-8f361c5604b9491c91c549db6a9719c1 2023-11-30 20:55:16,209 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-f4dface6e29b4f4284e3983996f2ad4d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family1/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-f4dface6e29b4f4284e3983996f2ad4d 2023-11-30 20:55:16,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-e83d4ccfd77343d8a98ce1000f42c3ff, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-477ebe4cf30745e58dfa03633401f81c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-eee1098d6ca049ac9caca067a04706b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-931cd85217e845a5bd300146bdc5d24b] to archive 2023-11-30 20:55:16,211 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:16,212 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-e83d4ccfd77343d8a98ce1000f42c3ff to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-e83d4ccfd77343d8a98ce1000f42c3ff 2023-11-30 20:55:16,213 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-477ebe4cf30745e58dfa03633401f81c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-477ebe4cf30745e58dfa03633401f81c 2023-11-30 20:55:16,214 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-eee1098d6ca049ac9caca067a04706b8 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-eee1098d6ca049ac9caca067a04706b8 2023-11-30 20:55:16,215 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-931cd85217e845a5bd300146bdc5d24b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/family2/testCompactionWithHFileLink=01ed825bd99347cac3dd87faa7414ea1-931cd85217e845a5bd300146bdc5d24b 2023-11-30 20:55:16,251 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=104 2023-11-30 20:55:16,252 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-30 20:55:16,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=ns:testMinorCompaction 2023-11-30 20:55:16,255 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:55:16,255 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "ns" qualifier: "testMinorCompaction" procId is: 105 2023-11-30 20:55:16,255 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:55:16,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-30 20:55:16,257 DEBUG [HFileArchiver-16] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:16,257 DEBUG [HFileArchiver-17] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:16,257 DEBUG [HFileArchiver-18] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:16,258 DEBUG [HFileArchiver-16] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94 empty. 2023-11-30 20:55:16,258 DEBUG [HFileArchiver-17] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299 empty. 2023-11-30 20:55:16,258 DEBUG [HFileArchiver-18] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee empty. 2023-11-30 20:55:16,258 DEBUG [HFileArchiver-16] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:16,258 DEBUG [HFileArchiver-17] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:16,258 DEBUG [HFileArchiver-18] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:16,258 DEBUG [PEWorker-3] procedure.DeleteTableProcedure(328): Archived ns:testMinorCompaction regions 2023-11-30 20:55:16,357 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-30 20:55:16,558 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-30 20:55:16,665 DEBUG [PEWorker-3] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/ns/testMinorCompaction/.tabledesc/.tableinfo.0000000001 2023-11-30 20:55:16,667 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(7675): creating {ENCODED => a3704dc0ee835a16ce967a1d260044ee, NAME => 'ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:55:16,667 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(7675): creating {ENCODED => bcfdcc2a31ec9769a470e90ff3f01299, NAME => 'ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:55:16,667 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5d30e55ca1973483a8d458e94f66df94, NAME => 'ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='ns:testMinorCompaction', {NAME => 'family1', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '5', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:55:16,859 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-30 20:55:17,050 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:55:17,073 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:17,073 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:17,073 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1604): Closing a3704dc0ee835a16ce967a1d260044ee, disabling compactions & flushes 2023-11-30 20:55:17,073 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1604): Closing bcfdcc2a31ec9769a470e90ff3f01299, disabling compactions & flushes 2023-11-30 20:55:17,073 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:17,073 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1604): Closing 5d30e55ca1973483a8d458e94f66df94, disabling compactions & flushes 2023-11-30 20:55:17,073 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:17,074 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. after waiting 0 ms 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:17,074 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. after waiting 0 ms 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-1] regionserver.HRegion(1558): Region close journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. after waiting 0 ms 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:17,074 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-0] regionserver.HRegion(1558): Region close journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:17,074 INFO [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:17,074 DEBUG [RegionOpenAndInit-ns:testMinorCompaction-pool-2] regionserver.HRegion(1558): Region close journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:17,077 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:55:17,078 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701377717078"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377717078"}]},"ts":"1701377717078"} 2023-11-30 20:55:17,078 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701377717078"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377717078"}]},"ts":"1701377717078"} 2023-11-30 20:55:17,078 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701377717078"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377717078"}]},"ts":"1701377717078"} 2023-11-30 20:55:17,080 INFO [PEWorker-3] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-30 20:55:17,081 INFO [PEWorker-3] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:55:17,081 DEBUG [PEWorker-3] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377717081"}]},"ts":"1701377717081"} 2023-11-30 20:55:17,082 INFO [PEWorker-3] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLING in hbase:meta 2023-11-30 20:55:17,088 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5d30e55ca1973483a8d458e94f66df94, ASSIGN}, {pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bcfdcc2a31ec9769a470e90ff3f01299, ASSIGN}, {pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a3704dc0ee835a16ce967a1d260044ee, ASSIGN}] 2023-11-30 20:55:17,089 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a3704dc0ee835a16ce967a1d260044ee, ASSIGN 2023-11-30 20:55:17,089 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bcfdcc2a31ec9769a470e90ff3f01299, ASSIGN 2023-11-30 20:55:17,089 INFO [PEWorker-1] procedure.MasterProcedureScheduler(727): Took xlock for pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5d30e55ca1973483a8d458e94f66df94, ASSIGN 2023-11-30 20:55:17,090 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=108, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a3704dc0ee835a16ce967a1d260044ee, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:55:17,090 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=107, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bcfdcc2a31ec9769a470e90ff3f01299, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:55:17,090 INFO [PEWorker-1] assignment.TransitRegionStateProcedure(193): Starting pid=106, ppid=105, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5d30e55ca1973483a8d458e94f66df94, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:55:17,242 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a3704dc0ee835a16ce967a1d260044ee, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:17,242 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5d30e55ca1973483a8d458e94f66df94, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:17,242 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bcfdcc2a31ec9769a470e90ff3f01299, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:17,243 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701377717242"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377717242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377717242"}]},"ts":"1701377717242"} 2023-11-30 20:55:17,243 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701377717242"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377717242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377717242"}]},"ts":"1701377717242"} 2023-11-30 20:55:17,243 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701377717242"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377717242"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377717242"}]},"ts":"1701377717242"} 2023-11-30 20:55:17,244 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=109, ppid=108, state=RUNNABLE; OpenRegionProcedure a3704dc0ee835a16ce967a1d260044ee, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:17,245 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=110, ppid=107, state=RUNNABLE; OpenRegionProcedure bcfdcc2a31ec9769a470e90ff3f01299, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:17,245 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=111, ppid=106, state=RUNNABLE; OpenRegionProcedure 5d30e55ca1973483a8d458e94f66df94, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:17,360 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-30 20:55:17,383 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family1/c8cf6d89b8f94dfaa029d022447f004a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/c8cf6d89b8f94dfaa029d022447f004a 2023-11-30 20:55:17,387 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 403bb60689734a0b812ff8d53e9885e9/family1 of 403bb60689734a0b812ff8d53e9885e9 into c8cf6d89b8f94dfaa029d022447f004a(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:17,387 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:55:17,387 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1701377715281; duration=1sec 2023-11-30 20:55:17,387 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=4), splitQueue=0 2023-11-30 20:55:17,387 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-30 20:55:17,390 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-30 20:55:17,390 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1912): 0ea9609bce6110fb1313e1d0e5a83ef8/family2 is initiating minor compaction (all files) 2023-11-30 20:55:17,390 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 0ea9609bce6110fb1313e1d0e5a83ef8/family2 in testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:55:17,390 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-446b7f31db84408bbf483a130fd5972b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f7c7c680c4d34784a21436eef5c564ed, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-b6dc491483184d198d4d54fffd425394, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-e0eecfe010694b6b87674eefa37ce9cf] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp, totalSize=20.4 K 2023-11-30 20:55:17,391 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-446b7f31db84408bbf483a130fd5972b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694411 2023-11-30 20:55:17,391 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f7c7c680c4d34784a21436eef5c564ed, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695796 2023-11-30 20:55:17,392 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-b6dc491483184d198d4d54fffd425394, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697214 2023-11-30 20:55:17,393 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-e0eecfe010694b6b87674eefa37ce9cf, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:17,393 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family1/cc5103ba9d4046eaac28380d8bc2bfc9 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/cc5103ba9d4046eaac28380d8bc2bfc9 2023-11-30 20:55:17,396 DEBUG [RSProcedureDispatcher-pool-0] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:17,397 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HStore(1652): Completed compaction of 5 (all) file(s) in 0ea9609bce6110fb1313e1d0e5a83ef8/family1 of 0ea9609bce6110fb1313e1d0e5a83ef8 into cc5103ba9d4046eaac28380d8bc2bfc9(size=7.6 K), total size for store is 7.6 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:17,397 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:55:17,397 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8., storeName=family1, fileCount=5, fileSize=28.9 K (5.4 K, 5.4 K, 5.4 K, 5.4 K, 7.3 K), priority=2, time=1701377716074; duration=1sec 2023-11-30 20:55:17,398 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=3), splitQueue=0 2023-11-30 20:55:17,398 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 4 store files, 0 compacting, 4 eligible, 16 blocking 2023-11-30 20:55:17,398 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:17,398 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5d30e55ca1973483a8d458e94f66df94, NAME => 'ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94.', STARTKEY => '', ENDKEY => '1'} 2023-11-30 20:55:17,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction 5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:17,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:17,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:17,399 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:17,400 INFO [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:17,400 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 4 files of size 20920 starting at candidate #0 after considering 3 permutations with 3 in ratio 2023-11-30 20:55:17,400 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HStore(1912): 403bb60689734a0b812ff8d53e9885e9/family2 is initiating minor compaction (all files) 2023-11-30 20:55:17,401 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HRegion(2259): Starting compaction of 403bb60689734a0b812ff8d53e9885e9/family2 in testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:55:17,401 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-7448739e94b141f9b706058e32b1442b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-27af4c497e904fd7a7d12d04be5a6357, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-3ca96eebd6354289b72f4761476dde1b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-91ed6412283d4c489156efa3d7a4837c] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp, totalSize=20.4 K 2023-11-30 20:55:17,401 DEBUG [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1 2023-11-30 20:55:17,401 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-7448739e94b141f9b706058e32b1442b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377694409 2023-11-30 20:55:17,401 DEBUG [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1 2023-11-30 20:55:17,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-4b3fabc0db2445ba9659532eb7b22739, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-5328d89ed9df4868ab7db70d09635356, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f83b3fbd38734f6cada2e54c90a538a7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-a2f784fc39944e75944ea0381694de0b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f5a93f88497f4d5f9c23506e37d5c0b3_SeqId_34_] to archive 2023-11-30 20:55:17,402 INFO [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d30e55ca1973483a8d458e94f66df94 columnFamilyName family1 2023-11-30 20:55:17,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:17,403 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-27af4c497e904fd7a7d12d04be5a6357, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377695796 2023-11-30 20:55:17,403 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-3ca96eebd6354289b72f4761476dde1b, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377697213 2023-11-30 20:55:17,404 INFO [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] regionserver.HStore(310): Store=5d30e55ca1973483a8d458e94f66df94/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:17,404 INFO [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:17,404 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.Compactor(207): Compacting testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-91ed6412283d4c489156efa3d7a4837c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377698606 2023-11-30 20:55:17,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-4b3fabc0db2445ba9659532eb7b22739 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-4b3fabc0db2445ba9659532eb7b22739 2023-11-30 20:55:17,406 DEBUG [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2 2023-11-30 20:55:17,406 DEBUG [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2 2023-11-30 20:55:17,406 INFO [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5d30e55ca1973483a8d458e94f66df94 columnFamilyName family2 2023-11-30 20:55:17,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-5328d89ed9df4868ab7db70d09635356 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-5328d89ed9df4868ab7db70d09635356 2023-11-30 20:55:17,408 INFO [StoreOpener-5d30e55ca1973483a8d458e94f66df94-1] regionserver.HStore(310): Store=5d30e55ca1973483a8d458e94f66df94/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:17,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f83b3fbd38734f6cada2e54c90a538a7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f83b3fbd38734f6cada2e54c90a538a7 2023-11-30 20:55:17,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:17,409 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:17,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-a2f784fc39944e75944ea0381694de0b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-a2f784fc39944e75944ea0381694de0b 2023-11-30 20:55:17,411 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 0ea9609bce6110fb1313e1d0e5a83ef8#family2#compaction#118 average throughput is 0.23 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:55:17,411 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f5a93f88497f4d5f9c23506e37d5c0b3_SeqId_34_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family1/f5a93f88497f4d5f9c23506e37d5c0b3_SeqId_34_ 2023-11-30 20:55:17,411 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:55:17,413 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:55:17,413 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-fee583d8b3f1490381d50bacf3ef068a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-83820ba9973a44c8b9790d7f023c01cd, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-9c69ecd96ca848018737b813febb37b8, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-d5fc256bca694ca189a88e74cf1d51b4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/4a2f5f299ca74e18b61eebc1b8e6c210_SeqId_34_] to archive 2023-11-30 20:55:17,414 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:17,416 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-fee583d8b3f1490381d50bacf3ef068a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-fee583d8b3f1490381d50bacf3ef068a 2023-11-30 20:55:17,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:55:17,416 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5d30e55ca1973483a8d458e94f66df94; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=58767046, jitterRate=-0.12430277466773987}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:55:17,416 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:17,417 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-83820ba9973a44c8b9790d7f023c01cd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-83820ba9973a44c8b9790d7f023c01cd 2023-11-30 20:55:17,417 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94., pid=111, masterSystemTime=1701377717396 2023-11-30 20:55:17,418 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-9c69ecd96ca848018737b813febb37b8 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-9c69ecd96ca848018737b813febb37b8 2023-11-30 20:55:17,418 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:17,418 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:17,419 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:17,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => a3704dc0ee835a16ce967a1d260044ee, NAME => 'ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee.', STARTKEY => '2', ENDKEY => ''} 2023-11-30 20:55:17,419 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=106 updating hbase:meta row=5d30e55ca1973483a8d458e94f66df94, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:17,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:17,419 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701377717419"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377717419"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377717419"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377717419"}]},"ts":"1701377717419"} 2023-11-30 20:55:17,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:17,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:17,419 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:17,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=111, resume processing ppid=106 2023-11-30 20:55:17,421 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=111, ppid=106, state=SUCCESS; OpenRegionProcedure 5d30e55ca1973483a8d458e94f66df94, server=jenkins-hbase4.apache.org,40365,1701377600631 in 175 msec 2023-11-30 20:55:17,422 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=106, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=5d30e55ca1973483a8d458e94f66df94, ASSIGN in 333 msec 2023-11-30 20:55:17,424 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-d5fc256bca694ca189a88e74cf1d51b4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-d5fc256bca694ca189a88e74cf1d51b4 2023-11-30 20:55:17,424 INFO [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:17,425 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/4a2f5f299ca74e18b61eebc1b8e6c210_SeqId_34_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family1/4a2f5f299ca74e18b61eebc1b8e6c210_SeqId_34_ 2023-11-30 20:55:17,425 DEBUG [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1 2023-11-30 20:55:17,425 DEBUG [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1 2023-11-30 20:55:17,425 INFO [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3704dc0ee835a16ce967a1d260044ee columnFamilyName family1 2023-11-30 20:55:17,426 INFO [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] regionserver.HStore(310): Store=a3704dc0ee835a16ce967a1d260044ee/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:17,426 INFO [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:17,427 DEBUG [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2 2023-11-30 20:55:17,427 DEBUG [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2 2023-11-30 20:55:17,428 INFO [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region a3704dc0ee835a16ce967a1d260044ee columnFamilyName family2 2023-11-30 20:55:17,429 INFO [StoreOpener-a3704dc0ee835a16ce967a1d260044ee-1] regionserver.HStore(310): Store=a3704dc0ee835a16ce967a1d260044ee/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:17,434 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] throttle.PressureAwareThroughputController(145): 403bb60689734a0b812ff8d53e9885e9#family2#compaction#119 average throughput is 0.08 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 53.85 MB/second 2023-11-30 20:55:17,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:17,435 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:17,437 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:55:17,438 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:55:17,445 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:55:17,445 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened a3704dc0ee835a16ce967a1d260044ee; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=65288037, jitterRate=-0.027132436633110046}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:55:17,446 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:17,446 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee., pid=109, masterSystemTime=1701377717396 2023-11-30 20:55:17,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:17,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:17,448 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:17,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => bcfdcc2a31ec9769a470e90ff3f01299, NAME => 'ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299.', STARTKEY => '1', ENDKEY => '2'} 2023-11-30 20:55:17,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompaction bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:17,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:17,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:17,448 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:17,449 INFO [PEWorker-2] assignment.RegionStateStore(219): pid=108 updating hbase:meta row=a3704dc0ee835a16ce967a1d260044ee, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:17,449 DEBUG [PEWorker-2] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee.","families":{"info":[{"qualifier":"regioninfo","vlen":49,"tag":[],"timestamp":"1701377717449"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377717449"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377717449"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377717449"}]},"ts":"1701377717449"} 2023-11-30 20:55:17,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=109, resume processing ppid=108 2023-11-30 20:55:17,451 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=109, ppid=108, state=SUCCESS; OpenRegionProcedure a3704dc0ee835a16ce967a1d260044ee, server=jenkins-hbase4.apache.org,40365,1701377600631 in 206 msec 2023-11-30 20:55:17,452 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=108, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=a3704dc0ee835a16ce967a1d260044ee, ASSIGN in 363 msec 2023-11-30 20:55:17,453 INFO [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:17,455 DEBUG [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1 2023-11-30 20:55:17,455 DEBUG [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1 2023-11-30 20:55:17,455 INFO [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcfdcc2a31ec9769a470e90ff3f01299 columnFamilyName family1 2023-11-30 20:55:17,456 INFO [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] regionserver.HStore(310): Store=bcfdcc2a31ec9769a470e90ff3f01299/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:17,457 INFO [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:17,459 DEBUG [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2 2023-11-30 20:55:17,459 DEBUG [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2 2023-11-30 20:55:17,459 INFO [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region bcfdcc2a31ec9769a470e90ff3f01299 columnFamilyName family2 2023-11-30 20:55:17,460 INFO [StoreOpener-bcfdcc2a31ec9769a470e90ff3f01299-1] regionserver.HStore(310): Store=bcfdcc2a31ec9769a470e90ff3f01299/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:17,463 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:17,464 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:17,469 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table ns:testMinorCompaction descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:55:17,471 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:55:17,472 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:55:17,473 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened bcfdcc2a31ec9769a470e90ff3f01299; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=66067962, jitterRate=-0.015510648488998413}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:55:17,473 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:17,474 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299., pid=110, masterSystemTime=1701377717396 2023-11-30 20:55:17,475 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:17,475 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:17,476 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=107 updating hbase:meta row=bcfdcc2a31ec9769a470e90ff3f01299, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:17,476 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299.","families":{"info":[{"qualifier":"regioninfo","vlen":50,"tag":[],"timestamp":"1701377717476"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377717476"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377717476"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377717476"}]},"ts":"1701377717476"} 2023-11-30 20:55:17,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=110, resume processing ppid=107 2023-11-30 20:55:17,479 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=110, ppid=107, state=SUCCESS; OpenRegionProcedure bcfdcc2a31ec9769a470e90ff3f01299, server=jenkins-hbase4.apache.org,40365,1701377600631 in 233 msec 2023-11-30 20:55:17,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=107, resume processing ppid=105 2023-11-30 20:55:17,480 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=107, ppid=105, state=SUCCESS; TransitRegionStateProcedure table=ns:testMinorCompaction, region=bcfdcc2a31ec9769a470e90ff3f01299, ASSIGN in 391 msec 2023-11-30 20:55:17,481 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:55:17,481 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"ns:testMinorCompaction","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377717481"}]},"ts":"1701377717481"} 2023-11-30 20:55:17,482 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=ns:testMinorCompaction, state=ENABLED in hbase:meta 2023-11-30 20:55:17,485 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=105, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=ns:testMinorCompaction execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:55:17,486 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=105, state=SUCCESS; CreateTableProcedure table=ns:testMinorCompaction in 1.2330 sec 2023-11-30 20:55:17,874 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/.tmp/family2/35e611f451fb4c3e9248366d07f000a8 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/35e611f451fb4c3e9248366d07f000a8 2023-11-30 20:55:17,878 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 403bb60689734a0b812ff8d53e9885e9/family2 of 403bb60689734a0b812ff8d53e9885e9 into 35e611f451fb4c3e9248366d07f000a8(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:17,878 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.HRegion(2289): Compaction status journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:55:17,878 INFO [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9., storeName=403bb60689734a0b812ff8d53e9885e9/family2, priority=12, startTime=1701377715014; duration=0sec 2023-11-30 20:55:17,878 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=2), splitQueue=0 2023-11-30 20:55:17,878 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-30 20:55:17,879 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-30 20:55:17,879 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-30 20:55:17,879 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. because compaction request was cancelled 2023-11-30 20:55:17,879 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.SortedCompactionPolicy(75): Selecting compaction from 1 store files, 0 compacting, 1 eligible, 16 blocking 2023-11-30 20:55:17,879 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 0 files of size 0 starting at candidate #-1 after considering 0 permutations with 0 in ratio 2023-11-30 20:55:17,879 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] compactions.SortedCompactionPolicy(232): Not compacting files because we only have 0 files ready for compaction. Need 3 to initiate. 2023-11-30 20:55:17,880 DEBUG [RS:0;jenkins-hbase4:40365-longCompactions-0] regionserver.CompactSplit(415): Not compacting testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. because compaction request was cancelled 2023-11-30 20:55:17,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-7448739e94b141f9b706058e32b1442b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-27af4c497e904fd7a7d12d04be5a6357, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-3ca96eebd6354289b72f4761476dde1b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-91ed6412283d4c489156efa3d7a4837c] to archive 2023-11-30 20:55:17,902 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:17,904 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-7448739e94b141f9b706058e32b1442b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-7448739e94b141f9b706058e32b1442b 2023-11-30 20:55:17,905 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-27af4c497e904fd7a7d12d04be5a6357 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-27af4c497e904fd7a7d12d04be5a6357 2023-11-30 20:55:17,906 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-3ca96eebd6354289b72f4761476dde1b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-3ca96eebd6354289b72f4761476dde1b 2023-11-30 20:55:17,907 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-91ed6412283d4c489156efa3d7a4837c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/family2/testCompactionWithHFileLink=403bb60689734a0b812ff8d53e9885e9-91ed6412283d4c489156efa3d7a4837c 2023-11-30 20:55:18,361 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=105 2023-11-30 20:55:18,361 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: ns:testMinorCompaction, procId: 105 completed 2023-11-30 20:55:18,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:18,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:18,367 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:18,369 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:18,371 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-30 20:55:18,371 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-30 20:55:18,371 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:18,371 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-30 20:55:18,371 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-30 20:55:18,371 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:18,371 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:18,375 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:18,375 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:18,375 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:18,375 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:18,376 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:18,376 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:18,376 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:18,376 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:18,376 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-30 20:55:18,376 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-30 20:55:18,377 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-30 20:55:18,377 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:18,377 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-30 20:55:18,377 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:18,377 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:18,389 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:18,389 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:18,389 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:18,377 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. started... 2023-11-30 20:55:18,389 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. started... 2023-11-30 20:55:18,389 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. started... 2023-11-30 20:55:18,391 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3704dc0ee835a16ce967a1d260044ee 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-30 20:55:18,391 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bcfdcc2a31ec9769a470e90ff3f01299 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-30 20:55:18,391 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5d30e55ca1973483a8d458e94f66df94 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-30 20:55:18,391 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:55:18,391 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x14921606 to 127.0.0.1:58095 2023-11-30 20:55:18,391 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:55:18,392 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:55:18,392 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x297558a3 to 127.0.0.1:58095 2023-11-30 20:55:18,392 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:55:18,392 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:55:18,392 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x27cdb3ae to 127.0.0.1:58095 2023-11-30 20:55:18,392 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:55:18,629 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/.tmp/family2/a9ae454d36bf4b95990b65d93de5a1f9 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/a9ae454d36bf4b95990b65d93de5a1f9 2023-11-30 20:55:18,633 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 4 (all) file(s) in 0ea9609bce6110fb1313e1d0e5a83ef8/family2 of 0ea9609bce6110fb1313e1d0e5a83ef8 into a9ae454d36bf4b95990b65d93de5a1f9(size=6.4 K), total size for store is 6.4 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:18,633 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:55:18,633 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction region=testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8., storeName=0ea9609bce6110fb1313e1d0e5a83ef8/family2, priority=12, startTime=1701377714943; duration=1sec 2023-11-30 20:55:18,633 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:55:18,706 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-446b7f31db84408bbf483a130fd5972b, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f7c7c680c4d34784a21436eef5c564ed, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-b6dc491483184d198d4d54fffd425394, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-e0eecfe010694b6b87674eefa37ce9cf] to archive 2023-11-30 20:55:18,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:18,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-446b7f31db84408bbf483a130fd5972b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-446b7f31db84408bbf483a130fd5972b 2023-11-30 20:55:18,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f7c7c680c4d34784a21436eef5c564ed to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-f7c7c680c4d34784a21436eef5c564ed 2023-11-30 20:55:18,710 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-b6dc491483184d198d4d54fffd425394 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-b6dc491483184d198d4d54fffd425394 2023-11-30 20:55:18,712 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-e0eecfe010694b6b87674eefa37ce9cf to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/family2/testCompactionWithHFileLink=0ea9609bce6110fb1313e1d0e5a83ef8-e0eecfe010694b6b87674eefa37ce9cf 2023-11-30 20:55:18,806 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113040635907daa244f7b10f11b1d18119da to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023113040635907daa244f7b10f11b1d18119da 2023-11-30 20:55:18,806 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130d334aa0d224943389d4be88cc2029745 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231130d334aa0d224943389d4be88cc2029745 2023-11-30 20:55:18,806 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130ddb3dda515fc4601977d90eddcc04dba to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231130ddb3dda515fc4601977d90eddcc04dba 2023-11-30 20:55:18,822 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/73a14cc1eadc40fc8f27836083451e32 2023-11-30 20:55:18,823 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/8f0fc4c0819144c49e82899dc3be8919 2023-11-30 20:55:19,219 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/e6181f4297d74c43858b47f2c60e399e 2023-11-30 20:55:19,235 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311308c0f3351520344d7ac39a6a1ea7de035 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311308c0f3351520344d7ac39a6a1ea7de035 2023-11-30 20:55:19,237 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130ae6fc30e86624a16a8c8ca3e0948474c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231130ae6fc30e86624a16a8c8ca3e0948474c 2023-11-30 20:55:19,237 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130821abfafe28948b08e1e4705404ca328 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231130821abfafe28948b08e1e4705404ca328 2023-11-30 20:55:19,249 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/289c413ce46348ab9e7b71925e2b0a71 2023-11-30 20:55:19,252 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/e6181f4297d74c43858b47f2c60e399e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/e6181f4297d74c43858b47f2c60e399e 2023-11-30 20:55:19,256 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/e6181f4297d74c43858b47f2c60e399e, entries=4, sequenceid=5, filesize=5.4 K 2023-11-30 20:55:19,256 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/289c413ce46348ab9e7b71925e2b0a71 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/289c413ce46348ab9e7b71925e2b0a71 2023-11-30 20:55:19,259 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/289c413ce46348ab9e7b71925e2b0a71, entries=2, sequenceid=5, filesize=5.1 K 2023-11-30 20:55:19,260 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for a3704dc0ee835a16ce967a1d260044ee in 869ms, sequenceid=5, compaction requested=false 2023-11-30 20:55:19,260 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'ns:testMinorCompaction' 2023-11-30 20:55:19,260 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:19,260 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:19,260 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:19,644 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/b6bc7e648dee4374bc5d087b99de106d 2023-11-30 20:55:19,648 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/73a14cc1eadc40fc8f27836083451e32 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/73a14cc1eadc40fc8f27836083451e32 2023-11-30 20:55:19,649 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/d18a7477b7084fbe82ded333d54aa373 2023-11-30 20:55:19,652 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/73a14cc1eadc40fc8f27836083451e32, entries=4, sequenceid=5, filesize=5.4 K 2023-11-30 20:55:19,653 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/b6bc7e648dee4374bc5d087b99de106d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/b6bc7e648dee4374bc5d087b99de106d 2023-11-30 20:55:19,654 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/8f0fc4c0819144c49e82899dc3be8919 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/8f0fc4c0819144c49e82899dc3be8919 2023-11-30 20:55:19,657 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/b6bc7e648dee4374bc5d087b99de106d, entries=2, sequenceid=5, filesize=5.1 K 2023-11-30 20:55:19,658 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for bcfdcc2a31ec9769a470e90ff3f01299 in 1267ms, sequenceid=5, compaction requested=false 2023-11-30 20:55:19,658 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/8f0fc4c0819144c49e82899dc3be8919, entries=4, sequenceid=5, filesize=5.4 K 2023-11-30 20:55:19,659 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:19,659 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:19,659 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:19,659 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/d18a7477b7084fbe82ded333d54aa373 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/d18a7477b7084fbe82ded333d54aa373 2023-11-30 20:55:19,662 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/d18a7477b7084fbe82ded333d54aa373, entries=2, sequenceid=5, filesize=5.1 K 2023-11-30 20:55:19,663 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5d30e55ca1973483a8d458e94f66df94 in 1272ms, sequenceid=5, compaction requested=false 2023-11-30 20:55:19,663 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:19,663 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:19,663 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:19,663 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:19,663 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,663 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-30 20:55:19,663 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-30 20:55:19,665 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,665 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:19,665 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:19,666 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:19,666 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:19,666 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:19,667 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,668 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:19,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-30 20:55:19,668 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@683c6c68[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:19,668 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-30 20:55:19,668 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:19,670 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:19,670 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:19,670 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:19,670 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-30 20:55:19,670 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-30 20:55:19,670 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:19,670 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,670 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:19,671 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,671 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-30 20:55:19,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:19,672 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:19,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:19,672 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-30 20:55:19,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:19,672 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,673 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:19,674 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,675 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:19,675 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-30 20:55:19,675 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-30 20:55:19,675 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:19,675 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:19,675 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-30 20:55:19,675 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:19,677 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:19,677 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:19,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:19,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:19,677 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:19,677 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:19,677 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:19,678 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:19,678 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:19,678 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:19,679 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,679 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:19,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:19,680 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,682 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,682 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:19,682 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:19,682 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:19,682 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:19,682 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-30 20:55:19,682 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,682 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-30 20:55:19,682 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:19,682 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:19,682 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:19,682 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:19,683 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:19,683 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:19,682 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:19,683 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:19,683 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:19,683 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:19,683 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:19,783 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:19,784 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:19,786 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:19,786 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:19,786 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:19,789 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:19,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:19,790 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-30 20:55:19,790 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-30 20:55:19,790 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:19,791 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-30 20:55:19,791 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-30 20:55:19,791 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:19,791 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:19,793 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,793 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:19,793 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:19,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:19,793 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:19,793 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:19,793 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:19,793 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:19,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:19,794 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:19,794 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-30 20:55:19,794 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-30 20:55:19,794 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-30 20:55:19,794 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-30 20:55:19,794 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:19,794 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-30 20:55:19,795 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:19,795 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:19,795 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. started... 2023-11-30 20:55:19,795 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. started... 2023-11-30 20:55:19,795 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bcfdcc2a31ec9769a470e90ff3f01299 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-30 20:55:19,795 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3704dc0ee835a16ce967a1d260044ee 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-30 20:55:19,797 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:19,797 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:19,797 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:19,797 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. started... 2023-11-30 20:55:19,797 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5d30e55ca1973483a8d458e94f66df94 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-30 20:55:19,828 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130f2d993623221439eb8d43727539890fe to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231130f2d993623221439eb8d43727539890fe 2023-11-30 20:55:19,830 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311309db2342a656b41d1965d5b81f60e27bd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311309db2342a656b41d1965d5b81f60e27bd 2023-11-30 20:55:19,848 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/e0ae3cf190cc40d9a37ab62101fc4cf2 2023-11-30 20:55:19,849 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/1f5266b7793449958dca893686be7392 2023-11-30 20:55:19,873 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130e15a9323705c4f3496c3fe9825990b03 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231130e15a9323705c4f3496c3fe9825990b03 2023-11-30 20:55:20,225 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311306694f6d6a9174cf39e22e3110ba102de to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311306694f6d6a9174cf39e22e3110ba102de 2023-11-30 20:55:20,268 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130ec047d0ba0d84c34bab38b367c8a3906 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231130ec047d0ba0d84c34bab38b367c8a3906 2023-11-30 20:55:20,272 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/11b3085b1f9944d28f57b11cb725ba2e 2023-11-30 20:55:20,277 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/e0ae3cf190cc40d9a37ab62101fc4cf2 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/e0ae3cf190cc40d9a37ab62101fc4cf2 2023-11-30 20:55:20,280 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/445960f2b7334229885a39c87b829d8f 2023-11-30 20:55:20,280 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/e0ae3cf190cc40d9a37ab62101fc4cf2, entries=4, sequenceid=9, filesize=5.4 K 2023-11-30 20:55:20,281 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/11b3085b1f9944d28f57b11cb725ba2e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/11b3085b1f9944d28f57b11cb725ba2e 2023-11-30 20:55:20,284 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/1f5266b7793449958dca893686be7392 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/1f5266b7793449958dca893686be7392 2023-11-30 20:55:20,285 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/11b3085b1f9944d28f57b11cb725ba2e, entries=2, sequenceid=9, filesize=5.1 K 2023-11-30 20:55:20,285 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for bcfdcc2a31ec9769a470e90ff3f01299 in 490ms, sequenceid=9, compaction requested=false 2023-11-30 20:55:20,285 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:20,285 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:20,286 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:20,288 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/1f5266b7793449958dca893686be7392, entries=4, sequenceid=9, filesize=5.4 K 2023-11-30 20:55:20,288 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/445960f2b7334229885a39c87b829d8f as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/445960f2b7334229885a39c87b829d8f 2023-11-30 20:55:20,292 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/445960f2b7334229885a39c87b829d8f, entries=2, sequenceid=9, filesize=5.1 K 2023-11-30 20:55:20,293 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for a3704dc0ee835a16ce967a1d260044ee in 498ms, sequenceid=9, compaction requested=false 2023-11-30 20:55:20,293 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:20,293 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:20,293 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:20,631 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/52e023fe14cd49839d3d2d95a5d994ca 2023-11-30 20:55:21,047 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130b17219b17a27416392aa2b847f62b465 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231130b17219b17a27416392aa2b847f62b465 2023-11-30 20:55:21,452 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/de062f13b16447ebaad716fc1d9d3c4c 2023-11-30 20:55:21,457 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/52e023fe14cd49839d3d2d95a5d994ca as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/52e023fe14cd49839d3d2d95a5d994ca 2023-11-30 20:55:21,461 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/52e023fe14cd49839d3d2d95a5d994ca, entries=4, sequenceid=9, filesize=5.4 K 2023-11-30 20:55:21,461 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/de062f13b16447ebaad716fc1d9d3c4c as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/de062f13b16447ebaad716fc1d9d3c4c 2023-11-30 20:55:21,465 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/de062f13b16447ebaad716fc1d9d3c4c, entries=2, sequenceid=9, filesize=5.1 K 2023-11-30 20:55:21,466 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5d30e55ca1973483a8d458e94f66df94 in 1669ms, sequenceid=9, compaction requested=false 2023-11-30 20:55:21,466 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:21,466 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:21,466 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:21,466 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:21,466 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,466 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-30 20:55:21,466 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-30 20:55:21,469 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,469 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:21,470 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:21,470 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:21,470 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,471 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:21,471 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-30 20:55:21,472 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6673e37c[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:21,472 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-30 20:55:21,472 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:21,473 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:21,473 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:21,473 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:21,473 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-30 20:55:21,473 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-30 20:55:21,473 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:21,473 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,473 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:21,475 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-30 20:55:21,475 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:21,475 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,475 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-30 20:55:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:21,475 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:21,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:21,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:21,476 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:21,477 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,478 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:21,478 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-30 20:55:21,478 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-30 20:55:21,478 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:21,478 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:21,478 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-30 20:55:21,478 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:21,481 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:21,481 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:21,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:21,481 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:21,481 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:21,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:21,482 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:21,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:21,482 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:21,483 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,483 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:21,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:21,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,485 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,485 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:21,485 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:21,485 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,485 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:21,485 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:21,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-30 20:55:21,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:21,485 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:21,485 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-30 20:55:21,485 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:21,486 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:21,486 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:21,485 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:21,486 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:21,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:21,486 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:21,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:21,586 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:21,587 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:21,588 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:21,588 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:21,589 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:21,591 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:21,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:21,593 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-30 20:55:21,593 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-30 20:55:21,593 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:21,593 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-30 20:55:21,593 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-30 20:55:21,593 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:21,593 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:21,595 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:21,595 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,595 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:21,595 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:21,595 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:21,595 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:21,596 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:21,596 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:21,596 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-30 20:55:21,597 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-30 20:55:21,597 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-30 20:55:21,597 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-30 20:55:21,597 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:21,597 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-30 20:55:21,599 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:21,599 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. started... 2023-11-30 20:55:21,599 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:21,599 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. started... 2023-11-30 20:55:21,599 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bcfdcc2a31ec9769a470e90ff3f01299 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-30 20:55:21,600 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3704dc0ee835a16ce967a1d260044ee 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-30 20:55:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:21,600 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:21,600 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:21,600 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. started... 2023-11-30 20:55:21,600 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5d30e55ca1973483a8d458e94f66df94 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-30 20:55:21,626 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130c8804f2800d740feb452e49dbc511877 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231130c8804f2800d740feb452e49dbc511877 2023-11-30 20:55:21,644 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130731cd1ebede54a25a9e19b0075752fb9 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231130731cd1ebede54a25a9e19b0075752fb9 2023-11-30 20:55:21,658 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/035f27b60c5b4f91a2f9f794af2e83fb 2023-11-30 20:55:22,038 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130708ca126e4244ec09e1d89115e9a26b5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231130708ca126e4244ec09e1d89115e9a26b5 2023-11-30 20:55:22,042 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/3e3d5262432e423aaf79270b398bf10f 2023-11-30 20:55:22,043 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/a42de641c2384b13ac6b613f22de5deb 2023-11-30 20:55:22,073 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130652746ba2f214ac9a20861de41a808c9 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231130652746ba2f214ac9a20861de41a808c9 2023-11-30 20:55:22,202 DEBUG [regionserver/jenkins-hbase4:0.Chore.1] throttle.PressureAwareCompactionThroughputController(103): CompactionPressure is 0.0, tune throughput to 50.00 MB/second 2023-11-30 20:55:22,462 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130ae94215cb15145aaae2668567519d7a7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c20231130ae94215cb15145aaae2668567519d7a7 2023-11-30 20:55:22,463 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023113016175957a46a4af7b85cfa58d2c37b84 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b2023113016175957a46a4af7b85cfa58d2c37b84 2023-11-30 20:55:22,482 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/1062dc6b69744fe28bff06f7bf33f894 2023-11-30 20:55:22,486 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/035f27b60c5b4f91a2f9f794af2e83fb as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/035f27b60c5b4f91a2f9f794af2e83fb 2023-11-30 20:55:22,489 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/035f27b60c5b4f91a2f9f794af2e83fb, entries=4, sequenceid=13, filesize=5.4 K 2023-11-30 20:55:22,490 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/1062dc6b69744fe28bff06f7bf33f894 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/1062dc6b69744fe28bff06f7bf33f894 2023-11-30 20:55:22,493 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/1062dc6b69744fe28bff06f7bf33f894, entries=2, sequenceid=13, filesize=5.1 K 2023-11-30 20:55:22,493 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5d30e55ca1973483a8d458e94f66df94 in 893ms, sequenceid=13, compaction requested=true 2023-11-30 20:55:22,493 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:22,493 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:22,493 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:22,867 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/211d285c8e6a4dc8b03664ad3410da3d 2023-11-30 20:55:22,867 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/6bd8301af9334edaa31ac5569acb91e4 2023-11-30 20:55:22,872 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/a42de641c2384b13ac6b613f22de5deb as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/a42de641c2384b13ac6b613f22de5deb 2023-11-30 20:55:22,872 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/3e3d5262432e423aaf79270b398bf10f as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/3e3d5262432e423aaf79270b398bf10f 2023-11-30 20:55:22,875 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/a42de641c2384b13ac6b613f22de5deb, entries=4, sequenceid=13, filesize=5.4 K 2023-11-30 20:55:22,875 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/3e3d5262432e423aaf79270b398bf10f, entries=4, sequenceid=13, filesize=5.4 K 2023-11-30 20:55:22,876 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/211d285c8e6a4dc8b03664ad3410da3d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/211d285c8e6a4dc8b03664ad3410da3d 2023-11-30 20:55:22,876 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/6bd8301af9334edaa31ac5569acb91e4 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/6bd8301af9334edaa31ac5569acb91e4 2023-11-30 20:55:22,879 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/211d285c8e6a4dc8b03664ad3410da3d, entries=2, sequenceid=13, filesize=5.1 K 2023-11-30 20:55:22,880 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/6bd8301af9334edaa31ac5569acb91e4, entries=2, sequenceid=13, filesize=5.1 K 2023-11-30 20:55:22,880 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for a3704dc0ee835a16ce967a1d260044ee in 1280ms, sequenceid=13, compaction requested=true 2023-11-30 20:55:22,880 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for bcfdcc2a31ec9769a470e90ff3f01299 in 1281ms, sequenceid=13, compaction requested=true 2023-11-30 20:55:22,880 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:22,880 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:22,880 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:22,880 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:22,880 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:22,880 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:22,881 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:22,881 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,881 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-30 20:55:22,881 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-30 20:55:22,883 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,883 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:22,883 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:22,883 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:22,883 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:22,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:22,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:22,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,884 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:22,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-30 20:55:22,885 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@769499cd[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:22,885 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-30 20:55:22,885 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:22,886 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:22,886 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:22,886 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:22,886 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-30 20:55:22,886 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-30 20:55:22,886 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:22,886 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,886 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:22,888 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-30 20:55:22,888 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,888 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:22,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:22,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:22,888 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-30 20:55:22,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:22,888 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:22,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:22,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:22,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:22,889 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,890 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:22,890 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-30 20:55:22,890 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-30 20:55:22,890 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:22,890 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:22,890 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-30 20:55:22,890 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:22,895 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:22,895 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:22,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:22,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:22,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:22,895 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:22,895 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:22,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:22,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:22,895 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,895 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:22,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:22,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:22,896 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,897 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:22,897 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:22,898 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,899 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,899 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:22,899 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:22,899 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:22,900 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:22,900 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:22,900 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:22,900 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:22,900 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-30 20:55:22,900 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:22,900 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:22,900 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:22,900 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:22,900 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-30 20:55:22,900 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:22,900 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:22,901 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:55:22,901 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:22,901 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:23,000 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:23,001 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:23,002 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:23,002 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:23,002 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(8805): writing data to region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:23,004 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:23,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:23,006 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-30 20:55:23,006 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-30 20:55:23,006 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:23,006 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-30 20:55:23,006 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-30 20:55:23,007 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:23,007 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:23,008 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:23,008 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:23,008 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:23,008 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:23,008 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:23,008 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:23,009 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:23,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:23,009 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:23,009 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-30 20:55:23,009 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-30 20:55:23,009 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-30 20:55:23,009 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-30 20:55:23,009 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:23,009 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-30 20:55:23,010 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:23,010 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. started... 2023-11-30 20:55:23,010 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:23,010 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. started... 2023-11-30 20:55:23,010 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bcfdcc2a31ec9769a470e90ff3f01299 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-30 20:55:23,010 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3704dc0ee835a16ce967a1d260044ee 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-30 20:55:23,011 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:23,011 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:23,011 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:23,011 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. started... 2023-11-30 20:55:23,011 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5d30e55ca1973483a8d458e94f66df94 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-30 20:55:23,422 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130fb17772de0a74a47902addc0904b789b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c20231130fb17772de0a74a47902addc0904b789b 2023-11-30 20:55:23,422 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130b4426d6335704dd79876cb528a114396 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231130b4426d6335704dd79876cb528a114396 2023-11-30 20:55:23,422 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023113035821bc3566e49df8a04db4df9bce75e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023113035821bc3566e49df8a04db4df9bce75e 2023-11-30 20:55:23,438 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/5156da6e9c1a44a5a3c2fb6da985ac90 2023-11-30 20:55:23,832 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/5af985a800554dfbac98296da5422a9e 2023-11-30 20:55:23,832 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/c71b292f69094181afb9b16c8d80d813 2023-11-30 20:55:23,861 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130bc206f7a20444f64925f8d7906f35745 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e20231130bc206f7a20444f64925f8d7906f35745 2023-11-30 20:55:24,293 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311300231ee8d882645ceb38bbb9d25bbf3ae to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b202311300231ee8d882645ceb38bbb9d25bbf3ae 2023-11-30 20:55:24,295 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/c7f75a4e16ee49b3a800aae4c6f87057 2023-11-30 20:55:24,298 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/4eab70b66c4c4a02af50c7ffbb344aea 2023-11-30 20:55:24,298 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113030020a602b5b4cac986b27d81c137fca to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c2023113030020a602b5b4cac986b27d81c137fca 2023-11-30 20:55:24,299 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/5156da6e9c1a44a5a3c2fb6da985ac90 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/5156da6e9c1a44a5a3c2fb6da985ac90 2023-11-30 20:55:24,302 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/5af985a800554dfbac98296da5422a9e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5af985a800554dfbac98296da5422a9e 2023-11-30 20:55:24,303 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/9665458ed74a42679c06324887147368 2023-11-30 20:55:24,303 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/5156da6e9c1a44a5a3c2fb6da985ac90, entries=4, sequenceid=17, filesize=5.4 K 2023-11-30 20:55:24,304 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/c7f75a4e16ee49b3a800aae4c6f87057 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/c7f75a4e16ee49b3a800aae4c6f87057 2023-11-30 20:55:24,306 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5af985a800554dfbac98296da5422a9e, entries=4, sequenceid=17, filesize=5.4 K 2023-11-30 20:55:24,307 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/4eab70b66c4c4a02af50c7ffbb344aea as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/4eab70b66c4c4a02af50c7ffbb344aea 2023-11-30 20:55:24,307 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/c71b292f69094181afb9b16c8d80d813 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/c71b292f69094181afb9b16c8d80d813 2023-11-30 20:55:24,308 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/c7f75a4e16ee49b3a800aae4c6f87057, entries=2, sequenceid=17, filesize=5.1 K 2023-11-30 20:55:24,309 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5d30e55ca1973483a8d458e94f66df94 in 1298ms, sequenceid=17, compaction requested=true 2023-11-30 20:55:24,309 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:24,309 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:24,309 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:24,311 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/4eab70b66c4c4a02af50c7ffbb344aea, entries=2, sequenceid=17, filesize=5.1 K 2023-11-30 20:55:24,311 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/c71b292f69094181afb9b16c8d80d813, entries=4, sequenceid=17, filesize=5.4 K 2023-11-30 20:55:24,312 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for bcfdcc2a31ec9769a470e90ff3f01299 in 1302ms, sequenceid=17, compaction requested=true 2023-11-30 20:55:24,312 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:24,312 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:24,312 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/9665458ed74a42679c06324887147368 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/9665458ed74a42679c06324887147368 2023-11-30 20:55:24,312 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:24,315 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/9665458ed74a42679c06324887147368, entries=2, sequenceid=17, filesize=5.1 K 2023-11-30 20:55:24,316 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for a3704dc0ee835a16ce967a1d260044ee in 1306ms, sequenceid=17, compaction requested=true 2023-11-30 20:55:24,316 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:24,316 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:24,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:24,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:24,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-30 20:55:24,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-30 20:55:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:24,318 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:24,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:24,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:24,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:24,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:24,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:24,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-30 20:55:24,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1381abda[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:24,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-30 20:55:24,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:24,322 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:24,322 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:24,322 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:24,322 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-30 20:55:24,322 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-30 20:55:24,322 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:24,323 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,323 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:24,324 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-30 20:55:24,324 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:24,324 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,324 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-30 20:55:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:24,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:24,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:24,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:24,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,325 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,326 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:24,326 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-30 20:55:24,326 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-30 20:55:24,326 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:24,326 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:24,326 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-30 20:55:24,326 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:24,328 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:24,328 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:24,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:24,329 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:24,329 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:24,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:24,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:24,330 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:24,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:24,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,332 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,332 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:24,333 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:24,333 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:24,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:24,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:24,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-30 20:55:24,333 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:24,333 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:24,333 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:24,333 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-30 20:55:24,333 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,333 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:24,333 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:24,333 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:24,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:24,333 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:24,333 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:24,333 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:24,433 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:24,434 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:24,443 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:24,451 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:24,458 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:24,459 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:24,485 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:24,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure ns:testMinorCompaction was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:24,487 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure ns:testMinorCompaction 2023-11-30 20:55:24,487 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'ns:testMinorCompaction' 2023-11-30 20:55:24,487 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:24,487 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'ns:testMinorCompaction' starting 'acquire' 2023-11-30 20:55:24,487 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'ns:testMinorCompaction', kicking off acquire phase on members. 2023-11-30 20:55:24,488 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:24,488 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:24,490 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,490 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:24,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:24,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:24,490 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:24,491 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:24,491 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:24,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:24,492 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for ns:testMinorCompaction 2023-11-30 20:55:24,493 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc ns:testMinorCompaction is still present, removing 2023-11-30 20:55:24,494 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:ns:testMinorCompaction 2023-11-30 20:55:24,494 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'ns:testMinorCompaction' with timeout 60000ms 2023-11-30 20:55:24,494 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:24,494 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'ns:testMinorCompaction' starting 'acquire' stage 2023-11-30 20:55:24,497 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:24,497 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. started... 2023-11-30 20:55:24,497 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:24,497 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:24,497 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:24,497 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:24,497 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. started... 2023-11-30 20:55:24,497 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing bcfdcc2a31ec9769a470e90ff3f01299 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-30 20:55:24,497 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 5d30e55ca1973483a8d458e94f66df94 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-30 20:55:24,497 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. started... 2023-11-30 20:55:24,497 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing a3704dc0ee835a16ce967a1d260044ee 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-30 20:55:24,512 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/5622577c00d8475e8a16fda771ba0f9b 2023-11-30 20:55:24,515 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5622577c00d8475e8a16fda771ba0f9b 2023-11-30 20:55:24,526 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/dbbc4fbda99e470aa85bc12267f48cb0 2023-11-30 20:55:24,529 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbbc4fbda99e470aa85bc12267f48cb0 2023-11-30 20:55:24,530 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/5622577c00d8475e8a16fda771ba0f9b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5622577c00d8475e8a16fda771ba0f9b 2023-11-30 20:55:24,533 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 5622577c00d8475e8a16fda771ba0f9b 2023-11-30 20:55:24,533 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5622577c00d8475e8a16fda771ba0f9b, entries=3, sequenceid=23, filesize=5.0 K 2023-11-30 20:55:24,534 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/dbbc4fbda99e470aa85bc12267f48cb0 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/dbbc4fbda99e470aa85bc12267f48cb0 2023-11-30 20:55:24,537 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for dbbc4fbda99e470aa85bc12267f48cb0 2023-11-30 20:55:24,537 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/dbbc4fbda99e470aa85bc12267f48cb0, entries=1, sequenceid=23, filesize=5.0 K 2023-11-30 20:55:24,538 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for bcfdcc2a31ec9769a470e90ff3f01299 in 41ms, sequenceid=23, compaction requested=true 2023-11-30 20:55:24,538 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:24,538 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:24,538 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:24,911 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/87ba4313e7634a3b87565bb8927bf764 2023-11-30 20:55:24,916 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87ba4313e7634a3b87565bb8927bf764 2023-11-30 20:55:25,315 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/7401e467687241218075ee825d24b8e6 2023-11-30 20:55:25,319 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7401e467687241218075ee825d24b8e6 2023-11-30 20:55:25,726 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/64d4cf5d98ca45d6b73b0d062a4c94b3 2023-11-30 20:55:25,730 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64d4cf5d98ca45d6b73b0d062a4c94b3 2023-11-30 20:55:25,731 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/87ba4313e7634a3b87565bb8927bf764 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/87ba4313e7634a3b87565bb8927bf764 2023-11-30 20:55:25,731 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/6fba3079b2b148c79321f138a91e69cb 2023-11-30 20:55:25,735 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fba3079b2b148c79321f138a91e69cb 2023-11-30 20:55:25,735 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87ba4313e7634a3b87565bb8927bf764 2023-11-30 20:55:25,735 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/87ba4313e7634a3b87565bb8927bf764, entries=3, sequenceid=23, filesize=5.0 K 2023-11-30 20:55:25,736 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/7401e467687241218075ee825d24b8e6 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/7401e467687241218075ee825d24b8e6 2023-11-30 20:55:25,736 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/64d4cf5d98ca45d6b73b0d062a4c94b3 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/64d4cf5d98ca45d6b73b0d062a4c94b3 2023-11-30 20:55:25,739 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 7401e467687241218075ee825d24b8e6 2023-11-30 20:55:25,739 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/7401e467687241218075ee825d24b8e6, entries=3, sequenceid=23, filesize=5.0 K 2023-11-30 20:55:25,740 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 64d4cf5d98ca45d6b73b0d062a4c94b3 2023-11-30 20:55:25,740 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/64d4cf5d98ca45d6b73b0d062a4c94b3, entries=1, sequenceid=23, filesize=5.0 K 2023-11-30 20:55:25,740 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/6fba3079b2b148c79321f138a91e69cb as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/6fba3079b2b148c79321f138a91e69cb 2023-11-30 20:55:25,741 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5d30e55ca1973483a8d458e94f66df94 in 1244ms, sequenceid=23, compaction requested=true 2023-11-30 20:55:25,741 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:25,741 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:25,741 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:25,744 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6fba3079b2b148c79321f138a91e69cb 2023-11-30 20:55:25,744 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/6fba3079b2b148c79321f138a91e69cb, entries=1, sequenceid=23, filesize=5.0 K 2023-11-30 20:55:25,745 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for a3704dc0ee835a16ce967a1d260044ee in 1248ms, sequenceid=23, compaction requested=true 2023-11-30 20:55:25,745 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:25,745 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:25,745 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:25,745 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:25,745 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,745 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'ns:testMinorCompaction' locally acquired 2023-11-30 20:55:25,745 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (ns:testMinorCompaction) in zk 2023-11-30 20:55:25,747 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:25,747 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:25,747 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:25,748 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:25,748 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'ns:testMinorCompaction' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:25,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:25,748 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,749 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:25,749 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'ns:testMinorCompaction' on coordinator 2023-11-30 20:55:25,750 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1855caee[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:25,750 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'ns:testMinorCompaction' starting 'in-barrier' execution. 2023-11-30 20:55:25,750 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:25,751 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:25,751 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:25,751 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:25,751 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'ns:testMinorCompaction' received 'reached' from coordinator. 2023-11-30 20:55:25,751 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'ns:testMinorCompaction' locally completed 2023-11-30 20:55:25,751 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,751 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:25,751 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'ns:testMinorCompaction' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:25,753 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'ns:testMinorCompaction' has notified controller of completion 2023-11-30 20:55:25,753 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:25,753 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,753 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'ns:testMinorCompaction' completed. 2023-11-30 20:55:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:25,753 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,754 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:25,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:25,758 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,759 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'ns:testMinorCompaction' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:25,759 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'ns:testMinorCompaction', counting down latch. Waiting for 0 more 2023-11-30 20:55:25,759 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'ns:testMinorCompaction' execution completed 2023-11-30 20:55:25,759 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:25,759 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:25,759 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:ns:testMinorCompaction 2023-11-30 20:55:25,759 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure ns:testMinorCompactionincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:25,760 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:25,760 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:25,760 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:25,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:25,761 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:25,761 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,761 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:25,761 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:25,762 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:25,763 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,763 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:25,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----ns:testMinorCompaction 2023-11-30 20:55:25,764 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/ns:testMinorCompaction 2023-11-30 20:55:25,767 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:25,767 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:25,767 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'ns:testMinorCompaction' 2023-11-30 20:55:25,767 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:25,767 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/ns:testMinorCompaction because node does not exist (not an error) 2023-11-30 20:55:25,767 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/ns:testMinorCompaction 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/ns:testMinorCompaction 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : ns:testMinorCompaction'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:25,767 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:25,768 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:25,768 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:25,868 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:25,869 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:25,869 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:25,869 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): bcfdcc2a31ec9769a470e90ff3f01299/family1 is initiating major compaction (all files) 2023-11-30 20:55:25,869 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:25,870 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:25,870 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of bcfdcc2a31ec9769a470e90ff3f01299/family1 in ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:25,871 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/73a14cc1eadc40fc8f27836083451e32, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/e0ae3cf190cc40d9a37ab62101fc4cf2, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/3e3d5262432e423aaf79270b398bf10f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5af985a800554dfbac98296da5422a9e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5622577c00d8475e8a16fda771ba0f9b] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp, totalSize=26.6 K 2023-11-30 20:55:25,871 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 73a14cc1eadc40fc8f27836083451e32, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377718367 2023-11-30 20:55:25,872 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting e0ae3cf190cc40d9a37ab62101fc4cf2, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377719786 2023-11-30 20:55:25,872 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 3e3d5262432e423aaf79270b398bf10f, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377721588 2023-11-30 20:55:25,873 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 5af985a800554dfbac98296da5422a9e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377723002 2023-11-30 20:55:25,873 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 5622577c00d8475e8a16fda771ba0f9b, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:25,886 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): bcfdcc2a31ec9769a470e90ff3f01299#family1#compaction#150 average throughput is 0.41 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:26,299 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023113096a1ac6c677a4b1abca223ecb80725fe_del 2023-11-30 20:55:26,300 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023113096a1ac6c677a4b1abca223ecb80725fe_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b2023113096a1ac6c677a4b1abca223ecb80725fe_del 2023-11-30 20:55:27,116 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3155c04528bf46b19083bb5b41663639 2023-11-30 20:55:27,116 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family1/3155c04528bf46b19083bb5b41663639 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/3155c04528bf46b19083bb5b41663639 2023-11-30 20:55:27,120 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 3155c04528bf46b19083bb5b41663639 2023-11-30 20:55:27,121 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bcfdcc2a31ec9769a470e90ff3f01299/family1 of bcfdcc2a31ec9769a470e90ff3f01299 into 3155c04528bf46b19083bb5b41663639(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:27,121 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:27,121 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:27,121 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): bcfdcc2a31ec9769a470e90ff3f01299/family2 is initiating major compaction (all files) 2023-11-30 20:55:27,121 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:27,121 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:27,122 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of bcfdcc2a31ec9769a470e90ff3f01299/family2 in ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:55:27,122 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/b6bc7e648dee4374bc5d087b99de106d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/11b3085b1f9944d28f57b11cb725ba2e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/6bd8301af9334edaa31ac5569acb91e4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/4eab70b66c4c4a02af50c7ffbb344aea, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/dbbc4fbda99e470aa85bc12267f48cb0] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp, totalSize=25.3 K 2023-11-30 20:55:27,122 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting b6bc7e648dee4374bc5d087b99de106d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377718367 2023-11-30 20:55:27,122 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 11b3085b1f9944d28f57b11cb725ba2e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377719786 2023-11-30 20:55:27,123 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 6bd8301af9334edaa31ac5569acb91e4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377721588 2023-11-30 20:55:27,123 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 4eab70b66c4c4a02af50c7ffbb344aea, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377723002 2023-11-30 20:55:27,124 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting dbbc4fbda99e470aa85bc12267f48cb0, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:27,133 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): bcfdcc2a31ec9769a470e90ff3f01299#family2#compaction#151 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:27,202 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/73a14cc1eadc40fc8f27836083451e32, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/e0ae3cf190cc40d9a37ab62101fc4cf2, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/3e3d5262432e423aaf79270b398bf10f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5af985a800554dfbac98296da5422a9e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5622577c00d8475e8a16fda771ba0f9b] to archive 2023-11-30 20:55:27,203 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:27,204 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/73a14cc1eadc40fc8f27836083451e32 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/73a14cc1eadc40fc8f27836083451e32 2023-11-30 20:55:27,205 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/e0ae3cf190cc40d9a37ab62101fc4cf2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/e0ae3cf190cc40d9a37ab62101fc4cf2 2023-11-30 20:55:27,206 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/3e3d5262432e423aaf79270b398bf10f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/3e3d5262432e423aaf79270b398bf10f 2023-11-30 20:55:27,207 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5af985a800554dfbac98296da5422a9e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5af985a800554dfbac98296da5422a9e 2023-11-30 20:55:27,208 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5622577c00d8475e8a16fda771ba0f9b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/5622577c00d8475e8a16fda771ba0f9b 2023-11-30 20:55:27,542 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231130654eb0e225f54d55b7cba93467ca73a4_del 2023-11-30 20:55:27,542 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130654eb0e225f54d55b7cba93467ca73a4_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c4ca4238a0b923820dcc509a6f75849b20231130654eb0e225f54d55b7cba93467ca73a4_del 2023-11-30 20:55:27,956 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36acf42328824d768a3402ba59e31a6a 2023-11-30 20:55:27,957 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/.tmp/family2/36acf42328824d768a3402ba59e31a6a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/36acf42328824d768a3402ba59e31a6a 2023-11-30 20:55:27,960 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 36acf42328824d768a3402ba59e31a6a 2023-11-30 20:55:27,962 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in bcfdcc2a31ec9769a470e90ff3f01299/family2 of bcfdcc2a31ec9769a470e90ff3f01299 into 36acf42328824d768a3402ba59e31a6a(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:27,962 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:27,962 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:27,962 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): a3704dc0ee835a16ce967a1d260044ee/family1 is initiating major compaction (all files) 2023-11-30 20:55:27,962 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:27,962 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:27,962 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of a3704dc0ee835a16ce967a1d260044ee/family1 in ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:27,962 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/e6181f4297d74c43858b47f2c60e399e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/1f5266b7793449958dca893686be7392, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/a42de641c2384b13ac6b613f22de5deb, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/c71b292f69094181afb9b16c8d80d813, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/7401e467687241218075ee825d24b8e6] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp, totalSize=26.6 K 2023-11-30 20:55:27,963 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting e6181f4297d74c43858b47f2c60e399e, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377718367 2023-11-30 20:55:27,963 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 1f5266b7793449958dca893686be7392, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377719786 2023-11-30 20:55:27,964 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting a42de641c2384b13ac6b613f22de5deb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377721589 2023-11-30 20:55:27,964 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting c71b292f69094181afb9b16c8d80d813, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377723002 2023-11-30 20:55:27,965 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 7401e467687241218075ee825d24b8e6, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:27,983 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): a3704dc0ee835a16ce967a1d260044ee#family1#compaction#152 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:28,005 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/b6bc7e648dee4374bc5d087b99de106d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/11b3085b1f9944d28f57b11cb725ba2e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/6bd8301af9334edaa31ac5569acb91e4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/4eab70b66c4c4a02af50c7ffbb344aea, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/dbbc4fbda99e470aa85bc12267f48cb0] to archive 2023-11-30 20:55:28,006 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:28,007 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/b6bc7e648dee4374bc5d087b99de106d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/b6bc7e648dee4374bc5d087b99de106d 2023-11-30 20:55:28,009 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/11b3085b1f9944d28f57b11cb725ba2e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/11b3085b1f9944d28f57b11cb725ba2e 2023-11-30 20:55:28,010 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/6bd8301af9334edaa31ac5569acb91e4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/6bd8301af9334edaa31ac5569acb91e4 2023-11-30 20:55:28,011 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/4eab70b66c4c4a02af50c7ffbb344aea to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/4eab70b66c4c4a02af50c7ffbb344aea 2023-11-30 20:55:28,013 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/dbbc4fbda99e470aa85bc12267f48cb0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family2/dbbc4fbda99e470aa85bc12267f48cb0 2023-11-30 20:55:28,395 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311307a1c8d9c64c3481fac26e454062a71a5_del 2023-11-30 20:55:28,395 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311307a1c8d9c64c3481fac26e454062a71a5_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c202311307a1c8d9c64c3481fac26e454062a71a5_del 2023-11-30 20:55:29,209 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1f0b7c53e754292960413757efef6be 2023-11-30 20:55:29,210 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family1/d1f0b7c53e754292960413757efef6be as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/d1f0b7c53e754292960413757efef6be 2023-11-30 20:55:29,213 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d1f0b7c53e754292960413757efef6be 2023-11-30 20:55:29,214 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a3704dc0ee835a16ce967a1d260044ee/family1 of a3704dc0ee835a16ce967a1d260044ee into d1f0b7c53e754292960413757efef6be(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:29,214 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:29,214 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:29,214 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): a3704dc0ee835a16ce967a1d260044ee/family2 is initiating major compaction (all files) 2023-11-30 20:55:29,214 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:29,214 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:29,214 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of a3704dc0ee835a16ce967a1d260044ee/family2 in ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:55:29,214 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/289c413ce46348ab9e7b71925e2b0a71, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/445960f2b7334229885a39c87b829d8f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/211d285c8e6a4dc8b03664ad3410da3d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/9665458ed74a42679c06324887147368, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/6fba3079b2b148c79321f138a91e69cb] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp, totalSize=25.3 K 2023-11-30 20:55:29,215 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 289c413ce46348ab9e7b71925e2b0a71, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377718367 2023-11-30 20:55:29,215 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 445960f2b7334229885a39c87b829d8f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377719786 2023-11-30 20:55:29,215 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 211d285c8e6a4dc8b03664ad3410da3d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377721589 2023-11-30 20:55:29,216 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 9665458ed74a42679c06324887147368, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377723002 2023-11-30 20:55:29,216 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 6fba3079b2b148c79321f138a91e69cb, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:29,225 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): a3704dc0ee835a16ce967a1d260044ee#family2#compaction#153 average throughput is 0.51 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:29,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/e6181f4297d74c43858b47f2c60e399e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/1f5266b7793449958dca893686be7392, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/a42de641c2384b13ac6b613f22de5deb, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/c71b292f69094181afb9b16c8d80d813, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/7401e467687241218075ee825d24b8e6] to archive 2023-11-30 20:55:29,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:29,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/e6181f4297d74c43858b47f2c60e399e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/e6181f4297d74c43858b47f2c60e399e 2023-11-30 20:55:29,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/1f5266b7793449958dca893686be7392 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/1f5266b7793449958dca893686be7392 2023-11-30 20:55:29,309 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/a42de641c2384b13ac6b613f22de5deb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/a42de641c2384b13ac6b613f22de5deb 2023-11-30 20:55:29,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/c71b292f69094181afb9b16c8d80d813 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/c71b292f69094181afb9b16c8d80d813 2023-11-30 20:55:29,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/7401e467687241218075ee825d24b8e6 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/7401e467687241218075ee825d24b8e6 2023-11-30 20:55:29,635 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311304a2b09b0a29e44c285b1d55b4747b935_del 2023-11-30 20:55:29,635 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311304a2b09b0a29e44c285b1d55b4747b935_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/c81e728d9d4c2f636f067f89cc14862c202311304a2b09b0a29e44c285b1d55b4747b935_del 2023-11-30 20:55:30,049 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4877b4817ab47f4a399735a0455eeec 2023-11-30 20:55:30,049 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/.tmp/family2/d4877b4817ab47f4a399735a0455eeec as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/d4877b4817ab47f4a399735a0455eeec 2023-11-30 20:55:30,053 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d4877b4817ab47f4a399735a0455eeec 2023-11-30 20:55:30,054 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in a3704dc0ee835a16ce967a1d260044ee/family2 of a3704dc0ee835a16ce967a1d260044ee into d4877b4817ab47f4a399735a0455eeec(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:30,054 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:30,054 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:30,054 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 5d30e55ca1973483a8d458e94f66df94/family1 is initiating major compaction (all files) 2023-11-30 20:55:30,055 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:30,055 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:30,055 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 5d30e55ca1973483a8d458e94f66df94/family1 in ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:30,055 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/8f0fc4c0819144c49e82899dc3be8919, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/52e023fe14cd49839d3d2d95a5d994ca, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/035f27b60c5b4f91a2f9f794af2e83fb, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/5156da6e9c1a44a5a3c2fb6da985ac90, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/87ba4313e7634a3b87565bb8927bf764] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp, totalSize=26.6 K 2023-11-30 20:55:30,055 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 8f0fc4c0819144c49e82899dc3be8919, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377718367 2023-11-30 20:55:30,056 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 52e023fe14cd49839d3d2d95a5d994ca, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377719786 2023-11-30 20:55:30,056 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 035f27b60c5b4f91a2f9f794af2e83fb, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377721588 2023-11-30 20:55:30,056 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 5156da6e9c1a44a5a3c2fb6da985ac90, keycount=4, bloomtype=ROW, size=5.4 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377723002 2023-11-30 20:55:30,057 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 87ba4313e7634a3b87565bb8927bf764, keycount=3, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:30,067 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 5d30e55ca1973483a8d458e94f66df94#family1#compaction#154 average throughput is 0.55 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:30,102 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/289c413ce46348ab9e7b71925e2b0a71, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/445960f2b7334229885a39c87b829d8f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/211d285c8e6a4dc8b03664ad3410da3d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/9665458ed74a42679c06324887147368, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/6fba3079b2b148c79321f138a91e69cb] to archive 2023-11-30 20:55:30,103 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:30,104 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/289c413ce46348ab9e7b71925e2b0a71 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/289c413ce46348ab9e7b71925e2b0a71 2023-11-30 20:55:30,106 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/445960f2b7334229885a39c87b829d8f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/445960f2b7334229885a39c87b829d8f 2023-11-30 20:55:30,107 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/211d285c8e6a4dc8b03664ad3410da3d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/211d285c8e6a4dc8b03664ad3410da3d 2023-11-30 20:55:30,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/9665458ed74a42679c06324887147368 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/9665458ed74a42679c06324887147368 2023-11-30 20:55:30,108 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/6fba3079b2b148c79321f138a91e69cb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family2/6fba3079b2b148c79321f138a91e69cb 2023-11-30 20:55:30,475 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311307d404eb560224cea9f4f5db2747d6311_del 2023-11-30 20:55:30,475 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311307d404eb560224cea9f4f5db2747d6311_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311307d404eb560224cea9f4f5db2747d6311_del 2023-11-30 20:55:31,289 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2444d8eeb88348cdb50ebc7b90c4237b 2023-11-30 20:55:31,289 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family1/2444d8eeb88348cdb50ebc7b90c4237b as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/2444d8eeb88348cdb50ebc7b90c4237b 2023-11-30 20:55:31,292 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 2444d8eeb88348cdb50ebc7b90c4237b 2023-11-30 20:55:31,293 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5d30e55ca1973483a8d458e94f66df94/family1 of 5d30e55ca1973483a8d458e94f66df94 into 2444d8eeb88348cdb50ebc7b90c4237b(size=6.8 K), total size for store is 6.8 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:31,293 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:31,293 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:31,294 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 5d30e55ca1973483a8d458e94f66df94/family2 is initiating major compaction (all files) 2023-11-30 20:55:31,294 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:31,294 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:31,294 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 5d30e55ca1973483a8d458e94f66df94/family2 in ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:55:31,295 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/d18a7477b7084fbe82ded333d54aa373, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/de062f13b16447ebaad716fc1d9d3c4c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/1062dc6b69744fe28bff06f7bf33f894, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/c7f75a4e16ee49b3a800aae4c6f87057, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/64d4cf5d98ca45d6b73b0d062a4c94b3] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp, totalSize=25.3 K 2023-11-30 20:55:31,295 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting d18a7477b7084fbe82ded333d54aa373, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377718367 2023-11-30 20:55:31,295 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting de062f13b16447ebaad716fc1d9d3c4c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377719786 2023-11-30 20:55:31,296 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 1062dc6b69744fe28bff06f7bf33f894, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377721588 2023-11-30 20:55:31,296 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting c7f75a4e16ee49b3a800aae4c6f87057, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377723002 2023-11-30 20:55:31,296 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 64d4cf5d98ca45d6b73b0d062a4c94b3, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:31,302 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/8f0fc4c0819144c49e82899dc3be8919, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/52e023fe14cd49839d3d2d95a5d994ca, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/035f27b60c5b4f91a2f9f794af2e83fb, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/5156da6e9c1a44a5a3c2fb6da985ac90, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/87ba4313e7634a3b87565bb8927bf764] to archive 2023-11-30 20:55:31,303 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:31,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/8f0fc4c0819144c49e82899dc3be8919 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/8f0fc4c0819144c49e82899dc3be8919 2023-11-30 20:55:31,305 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 5d30e55ca1973483a8d458e94f66df94#family2#compaction#155 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:31,306 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/52e023fe14cd49839d3d2d95a5d994ca to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/52e023fe14cd49839d3d2d95a5d994ca 2023-11-30 20:55:31,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/035f27b60c5b4f91a2f9f794af2e83fb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/035f27b60c5b4f91a2f9f794af2e83fb 2023-11-30 20:55:31,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/5156da6e9c1a44a5a3c2fb6da985ac90 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/5156da6e9c1a44a5a3c2fb6da985ac90 2023-11-30 20:55:31,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/87ba4313e7634a3b87565bb8927bf764 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/87ba4313e7634a3b87565bb8927bf764 2023-11-30 20:55:31,716 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e2023113024b055123ff345e3a6b940e21f084190_del 2023-11-30 20:55:31,716 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023113024b055123ff345e3a6b940e21f084190_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family2/d41d8cd98f00b204e9800998ecf8427e2023113024b055123ff345e3a6b940e21f084190_del 2023-11-30 20:55:32,530 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca93674243c04e6e9e4c2750cc136c34 2023-11-30 20:55:32,530 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/.tmp/family2/ca93674243c04e6e9e4c2750cc136c34 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/ca93674243c04e6e9e4c2750cc136c34 2023-11-30 20:55:32,533 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for ca93674243c04e6e9e4c2750cc136c34 2023-11-30 20:55:32,534 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5d30e55ca1973483a8d458e94f66df94/family2 of 5d30e55ca1973483a8d458e94f66df94 into ca93674243c04e6e9e4c2750cc136c34(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:55:32,534 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:32,537 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:32,540 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:32,543 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:32,543 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:32,548 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-30 20:55:32,560 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(306): The compaction type is PART_FILES, the request has 3 del files, 3 selected files, and 0 irrelevant files table 'ns:testMinorCompaction' and column 'family1' 2023-11-30 20:55:32,563 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311307d404eb560224cea9f4f5db2747d6311_del 2023-11-30 20:55:32,565 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023113096a1ac6c677a4b1abca223ecb80725fe_del 2023-11-30 20:55:32,568 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c202311307a1c8d9c64c3481fac26e454062a71a5_del 2023-11-30 20:55:32,568 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='ns:testMinorCompaction' column='family1' 2023-11-30 20:55:32,569 DEBUG [Listener at localhost/34291] zookeeper.ReadOnlyZKClient(139): Connect 0x1fc74ae2 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:55:32,574 DEBUG [Listener at localhost/34291] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@82f7ae8, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:55:32,576 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231130 for table='ns:testMinorCompaction' and column='family1' 2023-11-30 20:55:32,576 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231130 for table='ns:testMinorCompaction' and column='family1' 2023-11-30 20:55:32,576 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231130 for table='ns:testMinorCompaction' and column='family1' 2023-11-30 20:55:32,609 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/d18a7477b7084fbe82ded333d54aa373, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/de062f13b16447ebaad716fc1d9d3c4c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/1062dc6b69744fe28bff06f7bf33f894, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/c7f75a4e16ee49b3a800aae4c6f87057, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/64d4cf5d98ca45d6b73b0d062a4c94b3] to archive 2023-11-30 20:55:32,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:32,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/d18a7477b7084fbe82ded333d54aa373 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/d18a7477b7084fbe82ded333d54aa373 2023-11-30 20:55:32,612 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/de062f13b16447ebaad716fc1d9d3c4c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/de062f13b16447ebaad716fc1d9d3c4c 2023-11-30 20:55:32,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/1062dc6b69744fe28bff06f7bf33f894 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/1062dc6b69744fe28bff06f7bf33f894 2023-11-30 20:55:32,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/c7f75a4e16ee49b3a800aae4c6f87057 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/c7f75a4e16ee49b3a800aae4c6f87057 2023-11-30 20:55:32,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/64d4cf5d98ca45d6b73b0d062a4c94b3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family2/64d4cf5d98ca45d6b73b0d062a4c94b3 2023-11-30 20:55:33,403 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130aaaf709ec0c94aee87992969f5eca9aa to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231130aaaf709ec0c94aee87992969f5eca9aa 2023-11-30 20:55:33,404 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231130 table='ns:testMinorCompaction' column='family1' 2023-11-30 20:55:33,410 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311302e0e427564414ba599c4ebd655b19d7e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e202311302e0e427564414ba599c4ebd655b19d7e 2023-11-30 20:55:33,410 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113032923a9dc3af4279ba956bac2a68d6b2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023113032923a9dc3af4279ba956bac2a68d6b2 2023-11-30 20:55:33,411 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='ns:testMinorCompaction' column='family1' 2023-11-30 20:55:33,411 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='ns:testMinorCompaction' column='family1' 2023-11-30 20:55:33,417 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:55:33,420 INFO [RS-EventLoopGroup-3-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:47588, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:55:33,429 DEBUG [MobFileCompactionChore-pool-1] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:55:33,433 INFO [RS-EventLoopGroup-1-3] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:52122, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:55:33,451 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231130/family1/710503d7bec14e1fb6ddb73c0f2a8fa2 first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x01] 2023-11-30 20:55:33,451 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231130/family1/025bc99e7620428f95d778dd67c8800f first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x01] 2023-11-30 20:55:33,452 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231130/family1/710503d7bec14e1fb6ddb73c0f2a8fa2}] 2023-11-30 20:55:33,452 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231130/family1/712a51ff9909476da7846676cb834948 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x01] 2023-11-30 20:55:33,452 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231130/family1/025bc99e7620428f95d778dd67c8800f}] 2023-11-30 20:55:33,452 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231130/family1/712a51ff9909476da7846676cb834948}] 2023-11-30 20:55:33,457 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231130/family1/710503d7bec14e1fb6ddb73c0f2a8fa2 for inclusion in bcfdcc2a31ec9769a470e90ff3f01299/family1 2023-11-30 20:55:33,457 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231130/family1/025bc99e7620428f95d778dd67c8800f for inclusion in a3704dc0ee835a16ce967a1d260044ee/family1 2023-11-30 20:55:33,457 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231130/family1/712a51ff9909476da7846676cb834948 for inclusion in 5d30e55ca1973483a8d458e94f66df94/family1 2023-11-30 20:55:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x01 2023-11-30 20:55:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-30 20:55:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:55:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x01 2023-11-30 20:55:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x01 2023-11-30 20:55:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-30 20:55:33,459 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last=1 2023-11-30 20:55:33,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:55:33,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:55:33,460 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231130/family1/710503d7bec14e1fb6ddb73c0f2a8fa2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__4dnmhs6kaf6mkgf676fh25k0evm606d51jb8mbtuscf978mfcc34vnto2juleq53/family1/710503d7bec14e1fb6ddb73c0f2a8fa2 2023-11-30 20:55:33,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231130/family1/025bc99e7620428f95d778dd67c8800f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__q2c11m4ar0ib7qed04l4ctbqos560nv3od0acj3gpbej085lm4atubsl479903po/family1/025bc99e7620428f95d778dd67c8800f 2023-11-30 20:55:33,461 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231130/family1/712a51ff9909476da7846676cb834948 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__8fu3n55stoid3nrjcvbkmpet6oocrklpbol450tskgcqcn4lfog02a84faiigf1b/family1/712a51ff9909476da7846676cb834948 2023-11-30 20:55:33,463 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__4dnmhs6kaf6mkgf676fh25k0evm606d51jb8mbtuscf978mfcc34vnto2juleq53/family1/710503d7bec14e1fb6ddb73c0f2a8fa2 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/c474a24544034e4f869d415d909a9c73_SeqId_28_ 2023-11-30 20:55:33,464 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__4dnmhs6kaf6mkgf676fh25k0evm606d51jb8mbtuscf978mfcc34vnto2juleq53/family1/710503d7bec14e1fb6ddb73c0f2a8fa2 into bcfdcc2a31ec9769a470e90ff3f01299/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/c474a24544034e4f869d415d909a9c73_SeqId_28_ - updating store file list. 2023-11-30 20:55:33,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__8fu3n55stoid3nrjcvbkmpet6oocrklpbol450tskgcqcn4lfog02a84faiigf1b/family1/712a51ff9909476da7846676cb834948 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/4ad6c41330ac4c3ca6e70a52f74370a0_SeqId_28_ 2023-11-30 20:55:33,465 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__q2c11m4ar0ib7qed04l4ctbqos560nv3od0acj3gpbej085lm4atubsl479903po/family1/025bc99e7620428f95d778dd67c8800f as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/b1d1c56ad74e42d9b019a3b80b896ac0_SeqId_28_ 2023-11-30 20:55:33,465 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__8fu3n55stoid3nrjcvbkmpet6oocrklpbol450tskgcqcn4lfog02a84faiigf1b/family1/712a51ff9909476da7846676cb834948 into 5d30e55ca1973483a8d458e94f66df94/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/4ad6c41330ac4c3ca6e70a52f74370a0_SeqId_28_ - updating store file list. 2023-11-30 20:55:33,465 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__q2c11m4ar0ib7qed04l4ctbqos560nv3od0acj3gpbej085lm4atubsl479903po/family1/025bc99e7620428f95d778dd67c8800f into a3704dc0ee835a16ce967a1d260044ee/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/b1d1c56ad74e42d9b019a3b80b896ac0_SeqId_28_ - updating store file list. 2023-11-30 20:55:33,469 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/b1d1c56ad74e42d9b019a3b80b896ac0_SeqId_28_ into a3704dc0ee835a16ce967a1d260044ee/family1 2023-11-30 20:55:33,469 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__q2c11m4ar0ib7qed04l4ctbqos560nv3od0acj3gpbej085lm4atubsl479903po/family1/025bc99e7620428f95d778dd67c8800f into a3704dc0ee835a16ce967a1d260044ee/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/family1/b1d1c56ad74e42d9b019a3b80b896ac0_SeqId_28_) 2023-11-30 20:55:33,469 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/4ad6c41330ac4c3ca6e70a52f74370a0_SeqId_28_ into 5d30e55ca1973483a8d458e94f66df94/family1 2023-11-30 20:55:33,469 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__8fu3n55stoid3nrjcvbkmpet6oocrklpbol450tskgcqcn4lfog02a84faiigf1b/family1/712a51ff9909476da7846676cb834948 into 5d30e55ca1973483a8d458e94f66df94/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/family1/4ad6c41330ac4c3ca6e70a52f74370a0_SeqId_28_) 2023-11-30 20:55:33,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__q2c11m4ar0ib7qed04l4ctbqos560nv3od0acj3gpbej085lm4atubsl479903po/family1/025bc99e7620428f95d778dd67c8800f 2023-11-30 20:55:33,469 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__8fu3n55stoid3nrjcvbkmpet6oocrklpbol450tskgcqcn4lfog02a84faiigf1b/family1/712a51ff9909476da7846676cb834948 2023-11-30 20:55:33,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/c474a24544034e4f869d415d909a9c73_SeqId_28_ into bcfdcc2a31ec9769a470e90ff3f01299/family1 2023-11-30 20:55:33,469 INFO [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__4dnmhs6kaf6mkgf676fh25k0evm606d51jb8mbtuscf978mfcc34vnto2juleq53/family1/710503d7bec14e1fb6ddb73c0f2a8fa2 into bcfdcc2a31ec9769a470e90ff3f01299/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/family1/c474a24544034e4f869d415d909a9c73_SeqId_28_) 2023-11-30 20:55:33,470 DEBUG [RpcServer.default.FPBQ.Fifo.handler=2,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__ns_testMinorCompaction__4dnmhs6kaf6mkgf676fh25k0evm606d51jb8mbtuscf978mfcc34vnto2juleq53/family1/710503d7bec14e1fb6ddb73c0f2a8fa2 2023-11-30 20:55:33,471 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='ns:testMinorCompaction' column='family1' 2023-11-30 20:55:33,471 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='ns:testMinorCompaction' column='family1' 2023-11-30 20:55:33,471 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:33,471 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231130 table='ns:testMinorCompaction' column='family1' 2023-11-30 20:55:33,471 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:33,472 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:33,473 DEBUG [MobFileCompactionChore-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231130ddb3dda515fc4601977d90eddcc04dba to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/d41d8cd98f00b204e9800998ecf8427e20231130ddb3dda515fc4601977d90eddcc04dba 2023-11-30 20:55:33,473 INFO [MobFileCompactionChore-pool-0] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-30 20:55:33,473 DEBUG [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/d41d8cd98f00b204e9800998ecf8427e20231130' 2023-11-30 20:55:33,473 DEBUG [MobFileCompactionChore-pool-2] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023113040635907daa244f7b10f11b1d18119da to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c81e728d9d4c2f636f067f89cc14862c2023113040635907daa244f7b10f11b1d18119da 2023-11-30 20:55:33,473 INFO [MobFileCompactionChore-pool-2] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-30 20:55:33,473 INFO [MobFileCompactionChore-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231130 for table='ns:testMinorCompaction' and column='family1' 2023-11-30 20:55:33,473 DEBUG [MobFileCompactionChore-pool-1] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231130d334aa0d224943389d4be88cc2029745 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/ns/testMinorCompaction/eb474a9c8cfe32571864cdae147b59d3/family1/c4ca4238a0b923820dcc509a6f75849b20231130d334aa0d224943389d4be88cc2029745 2023-11-30 20:55:33,473 DEBUG [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c81e728d9d4c2f636f067f89cc14862c20231130' 2023-11-30 20:55:33,473 INFO [MobFileCompactionChore-pool-1] mob.MobUtils(508): Table ns:testMinorCompaction 1 expired mob files are deleted 2023-11-30 20:55:33,473 DEBUG [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/ns/testMinorCompaction/c4ca4238a0b923820dcc509a6f75849b20231130' 2023-11-30 20:55:33,474 INFO [MobFileCompactionChore-pool-2] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231130 for table='ns:testMinorCompaction' and column='family1' 2023-11-30 20:55:33,474 INFO [MobFileCompactionChore-pool-1] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231130 for table='ns:testMinorCompaction' and column='family1' 2023-11-30 20:55:33,474 INFO [Listener at localhost/34291] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='ns:testMinorCompaction' column='family1' 2023-11-30 20:55:33,476 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:33,478 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:33,480 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:33,481 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:33,497 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompaction Thread=251 (was 291), OpenFileDescriptor=655 (was 802), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=186 (was 211), ProcessCount=172 (was 172), AvailableMemoryMB=7514 (was 7517) 2023-11-30 20:55:33,508 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=251, OpenFileDescriptor=655, MaxFileDescriptor=60000, SystemLoadAverage=186, ProcessCount=172, AvailableMemoryMB=7514 2023-11-30 20:55:33,510 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'} 2023-11-30 20:55:33,510 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:33,512 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:55:33,512 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMinorCompactionWithMonthlyPolicy" procId is: 112 2023-11-30 20:55:33,513 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:55:33,513 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-30 20:55:33,514 DEBUG [HFileArchiver-19] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:55:33,514 DEBUG [HFileArchiver-19] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d empty. 2023-11-30 20:55:33,514 DEBUG [HFileArchiver-19] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:55:33,515 DEBUG [PEWorker-2] procedure.DeleteTableProcedure(328): Archived testMinorCompactionWithMonthlyPolicy regions 2023-11-30 20:55:33,614 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-30 20:55:33,814 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-30 20:55:33,921 DEBUG [PEWorker-2] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMinorCompactionWithMonthlyPolicy/.tabledesc/.tableinfo.0000000001 2023-11-30 20:55:33,922 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(7675): creating {ENCODED => 691aa403271da0d28d3018e7aaa1107d, NAME => 'testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d.', STARTKEY => '', ENDKEY => ''}, tableDescriptor='testMinorCompactionWithMonthlyPolicy', {NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:55:34,115 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-30 20:55:34,328 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:34,328 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1604): Closing 691aa403271da0d28d3018e7aaa1107d, disabling compactions & flushes 2023-11-30 20:55:34,328 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:34,328 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:34,328 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. after waiting 0 ms 2023-11-30 20:55:34,328 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:34,328 INFO [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:34,328 DEBUG [RegionOpenAndInit-testMinorCompactionWithMonthlyPolicy-pool-0] regionserver.HRegion(1558): Region close journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:34,330 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:55:34,331 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701377734331"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377734331"}]},"ts":"1701377734331"} 2023-11-30 20:55:34,332 INFO [PEWorker-2] hbase.MetaTableAccessor(1496): Added 1 regions to meta. 2023-11-30 20:55:34,333 INFO [PEWorker-2] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:55:34,333 DEBUG [PEWorker-2] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377734333"}]},"ts":"1701377734333"} 2023-11-30 20:55:34,334 INFO [PEWorker-2] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLING in hbase:meta 2023-11-30 20:55:34,337 INFO [PEWorker-2] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=691aa403271da0d28d3018e7aaa1107d, ASSIGN}] 2023-11-30 20:55:34,337 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=691aa403271da0d28d3018e7aaa1107d, ASSIGN 2023-11-30 20:55:34,338 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=113, ppid=112, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=691aa403271da0d28d3018e7aaa1107d, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:55:34,489 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=691aa403271da0d28d3018e7aaa1107d, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:34,489 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701377734489"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377734489"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377734489"}]},"ts":"1701377734489"} 2023-11-30 20:55:34,490 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=114, ppid=113, state=RUNNABLE; OpenRegionProcedure 691aa403271da0d28d3018e7aaa1107d, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:34,616 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-30 20:55:34,642 DEBUG [RSProcedureDispatcher-pool-1] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:34,644 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:34,644 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 691aa403271da0d28d3018e7aaa1107d, NAME => 'testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d.', STARTKEY => '', ENDKEY => ''} 2023-11-30 20:55:34,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMinorCompactionWithMonthlyPolicy 691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:55:34,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:34,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:55:34,645 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:55:34,646 INFO [StoreOpener-691aa403271da0d28d3018e7aaa1107d-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:55:34,648 DEBUG [StoreOpener-691aa403271da0d28d3018e7aaa1107d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1 2023-11-30 20:55:34,648 DEBUG [StoreOpener-691aa403271da0d28d3018e7aaa1107d-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1 2023-11-30 20:55:34,648 INFO [StoreOpener-691aa403271da0d28d3018e7aaa1107d-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 691aa403271da0d28d3018e7aaa1107d columnFamilyName family1 2023-11-30 20:55:34,649 INFO [StoreOpener-691aa403271da0d28d3018e7aaa1107d-1] regionserver.HStore(310): Store=691aa403271da0d28d3018e7aaa1107d/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:34,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:55:34,650 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:55:34,652 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:55:34,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:55:34,654 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 691aa403271da0d28d3018e7aaa1107d; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=63990096, jitterRate=-0.04647326469421387}}}, FlushLargeStoresPolicy{flushSizeLowerBound=-1} 2023-11-30 20:55:34,654 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:34,655 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d., pid=114, masterSystemTime=1701377734642 2023-11-30 20:55:34,656 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:34,656 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:34,656 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=113 updating hbase:meta row=691aa403271da0d28d3018e7aaa1107d, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:34,656 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d.","families":{"info":[{"qualifier":"regioninfo","vlen":70,"tag":[],"timestamp":"1701377734656"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377734656"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377734656"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377734656"}]},"ts":"1701377734656"} 2023-11-30 20:55:34,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=114, resume processing ppid=113 2023-11-30 20:55:34,658 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=114, ppid=113, state=SUCCESS; OpenRegionProcedure 691aa403271da0d28d3018e7aaa1107d, server=jenkins-hbase4.apache.org,40365,1701377600631 in 167 msec 2023-11-30 20:55:34,659 INFO [PEWorker-2] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=113, resume processing ppid=112 2023-11-30 20:55:34,660 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=113, ppid=112, state=SUCCESS; TransitRegionStateProcedure table=testMinorCompactionWithMonthlyPolicy, region=691aa403271da0d28d3018e7aaa1107d, ASSIGN in 321 msec 2023-11-30 20:55:34,660 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:55:34,660 DEBUG [PEWorker-5] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMinorCompactionWithMonthlyPolicy","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377734660"}]},"ts":"1701377734660"} 2023-11-30 20:55:34,661 INFO [PEWorker-5] hbase.MetaTableAccessor(1635): Updated tableName=testMinorCompactionWithMonthlyPolicy, state=ENABLED in hbase:meta 2023-11-30 20:55:34,664 INFO [PEWorker-5] procedure.CreateTableProcedure(80): pid=112, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:55:34,665 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=112, state=SUCCESS; CreateTableProcedure table=testMinorCompactionWithMonthlyPolicy in 1.1540 sec 2023-11-30 20:55:35,123 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:35,617 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=112 2023-11-30 20:55:35,617 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMinorCompactionWithMonthlyPolicy, procId: 112 completed 2023-11-30 20:55:35,633 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:35,635 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:35,635 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:35,635 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:35,635 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:35,635 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:35,635 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:35,635 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:35,637 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:35,637 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:35,637 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:35,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:35,637 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:35,637 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:35,637 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:35,638 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:35,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:35,638 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:35,638 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:35,640 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:35,640 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:35,640 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:35,640 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:35,641 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=74.11 KB heapSize=148.69 KB 2023-11-30 20:55:36,063 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151130a1f47b6ecaf74ecfad0754696f92e123 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a1f47b6ecaf74ecfad0754696f92e123 2023-11-30 20:55:36,467 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=74.1 K, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/897d6e9e80604341b59364f61e43eacf 2023-11-30 20:55:36,471 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/897d6e9e80604341b59364f61e43eacf as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/897d6e9e80604341b59364f61e43eacf 2023-11-30 20:55:36,474 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/897d6e9e80604341b59364f61e43eacf, entries=1000, sequenceid=5, filesize=166.0 K 2023-11-30 20:55:36,475 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74.11 KB/75890, heapSize ~148.67 KB/152240, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 834ms, sequenceid=5, compaction requested=false 2023-11-30 20:55:36,475 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:36,475 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:36,475 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:36,475 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:36,475 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,476 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:36,476 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:36,480 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,480 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:36,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:36,480 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,480 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:36,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:36,480 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:36,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,481 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:36,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:36,481 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@6144a29b[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:36,481 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:36,481 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,484 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,484 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,484 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,484 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:36,484 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:36,484 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:36,484 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,484 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:36,485 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:36,485 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,485 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:36,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,485 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:36,485 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,486 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,487 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,488 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:36,488 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:36,488 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:36,488 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:36,488 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:36,488 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,488 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:36,489 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,489 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,489 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:36,489 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:36,489 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:36,490 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:36,490 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,490 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:36,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,491 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,491 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,492 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:36,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:36,494 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:36,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:36,494 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:36,494 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:36,494 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,494 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:36,595 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:36,595 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:36,599 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:36,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:36,601 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,601 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:36,601 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:36,601 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:36,601 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:36,601 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,602 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,604 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:36,604 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,604 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:36,604 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:36,604 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:36,604 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,604 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:36,605 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,605 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,605 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:55:36,605 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:36,605 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:36,605 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:36,605 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:36,605 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:36,605 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:36,605 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:36,605 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:36,605 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=74 B heapSize=408 B 2023-11-30 20:55:37,017 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015112867561bc9873a44cd8a78625ee18500bb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112867561bc9873a44cd8a78625ee18500bb 2023-11-30 20:55:37,022 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=74, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/230c72bf0ec54998924e54b3f246f8a9 2023-11-30 20:55:37,026 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/230c72bf0ec54998924e54b3f246f8a9 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/230c72bf0ec54998924e54b3f246f8a9 2023-11-30 20:55:37,030 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/230c72bf0ec54998924e54b3f246f8a9, entries=1, sequenceid=9, filesize=5.0 K 2023-11-30 20:55:37,030 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~74 B/74, heapSize ~392 B/392, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 425ms, sequenceid=9, compaction requested=false 2023-11-30 20:55:37,031 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:37,031 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:37,031 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:37,033 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,033 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:37,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:37,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,035 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:37,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:37,035 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@33cc058f[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:37,035 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:37,035 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,036 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,036 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,037 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,037 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:37,037 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:37,037 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:37,037 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,037 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:37,038 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:37,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:37,038 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:37,038 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:37,039 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:37,041 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:37,041 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:37,041 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:37,041 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:37,041 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,041 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:37,043 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,043 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,043 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:37,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:37,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:37,044 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,045 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,046 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:37,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,048 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:37,048 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:37,048 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:37,048 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:37,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,048 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:55:37,048 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:37,049 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:37,049 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:37,048 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:37,049 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:37,049 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:37,149 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:37,150 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:37,153 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:37,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:37,154 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,154 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:37,155 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:37,155 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:37,155 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:37,155 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,155 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,156 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,156 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:37,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:37,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:37,157 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,157 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:37,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:37,158 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,158 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,158 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:55:37,158 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:37,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:37,158 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:37,158 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:37,158 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:55:37,568 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512017d65661c79034cf8b07eb9ab534b554a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512017d65661c79034cf8b07eb9ab534b554a 2023-11-30 20:55:37,973 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/c5633f82bba243959d49370856277186 2023-11-30 20:55:37,977 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/c5633f82bba243959d49370856277186 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/c5633f82bba243959d49370856277186 2023-11-30 20:55:37,980 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/c5633f82bba243959d49370856277186, entries=1, sequenceid=13, filesize=4.9 K 2023-11-30 20:55:37,981 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 823ms, sequenceid=13, compaction requested=true 2023-11-30 20:55:37,981 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:37,981 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:37,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:37,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:37,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:37,981 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:37,983 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,983 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,983 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:37,984 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:37,984 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:37,984 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:37,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:37,985 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@2d8db757[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:37,985 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:37,985 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,986 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,986 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,987 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:37,987 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:37,987 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:37,987 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,987 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:37,988 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,988 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:37,988 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,989 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,990 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:37,990 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:37,990 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:37,990 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:37,990 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:37,990 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,991 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:37,992 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,992 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:37,992 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:37,992 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,992 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:37,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:37,993 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:37,993 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:37,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,993 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,994 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:37,994 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:37,995 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,000 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,000 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,000 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,000 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:38,000 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,000 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:38,000 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:38,001 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:38,000 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:38,000 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:38,000 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,000 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:38,001 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,001 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,001 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:38,001 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:38,001 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:38,001 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:38,101 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:38,102 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:38,105 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:38,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:38,106 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,107 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:38,107 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:38,107 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:38,107 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:38,107 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,107 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,108 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:38,108 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,109 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:38,109 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,109 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:38,109 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,109 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:38,110 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,110 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,110 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:55:38,110 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:38,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:38,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:38,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:38,110 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:38,110 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:38,110 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:38,110 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:55:38,520 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015120573b915b565bc484cbb4478876953a514 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120573b915b565bc484cbb4478876953a514 2023-11-30 20:55:38,925 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/932b4ba6c4f14d9abd2260193605bc47 2023-11-30 20:55:38,930 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/932b4ba6c4f14d9abd2260193605bc47 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/932b4ba6c4f14d9abd2260193605bc47 2023-11-30 20:55:38,933 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/932b4ba6c4f14d9abd2260193605bc47, entries=1, sequenceid=17, filesize=4.9 K 2023-11-30 20:55:38,934 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 824ms, sequenceid=17, compaction requested=true 2023-11-30 20:55:38,934 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:38,934 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:38,934 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:38,934 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:38,934 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,934 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:38,934 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:38,936 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,936 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:38,936 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,936 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:38,936 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:38,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:38,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,937 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,938 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:38,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:38,938 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1b390ab2[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:38,938 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:38,938 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,940 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,940 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,940 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,940 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:38,940 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:38,940 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:38,940 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,940 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:38,942 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:38,942 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:38,942 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,942 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:38,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:38,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:38,942 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:38,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:38,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,943 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:38,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,944 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,945 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:38,945 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:38,945 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:38,945 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:38,945 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:38,945 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,945 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:38,947 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,947 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,947 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:38,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:38,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:38,947 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:38,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:38,947 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:38,947 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,948 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:38,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,949 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:38,949 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,950 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,951 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,951 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:38,951 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:38,951 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,951 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:38,952 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:38,952 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:38,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:38,952 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:38,951 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,952 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:38,952 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,952 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,952 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:38,952 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:38,952 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:38,952 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:38,952 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:39,052 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:39,053 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:39,057 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:39,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:39,059 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,059 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:39,059 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:39,059 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:39,059 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:39,059 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,059 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,061 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:39,061 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,061 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:39,061 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,061 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:39,061 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,062 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:39,062 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,062 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,062 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:55:39,062 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,062 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:39,062 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:39,062 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:39,063 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:39,063 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:39,063 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:39,063 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:55:39,490 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512284baa324bb0d247b98a890d9982b8a633 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284baa324bb0d247b98a890d9982b8a633 2023-11-30 20:55:39,896 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=21, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/2311fc48d9d547b2b0224ef93c78c896 2023-11-30 20:55:39,900 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/2311fc48d9d547b2b0224ef93c78c896 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/2311fc48d9d547b2b0224ef93c78c896 2023-11-30 20:55:39,903 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/2311fc48d9d547b2b0224ef93c78c896, entries=1, sequenceid=21, filesize=4.9 K 2023-11-30 20:55:39,904 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 841ms, sequenceid=21, compaction requested=true 2023-11-30 20:55:39,904 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:39,904 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:39,904 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:39,906 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,906 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:39,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,907 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:39,907 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,908 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:39,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:39,908 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5f2d3334[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:39,908 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:39,908 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,909 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,909 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,910 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:39,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:39,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:39,910 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,910 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:39,911 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,911 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:39,911 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:39,911 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:39,911 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:39,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:39,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:39,913 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:39,913 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:39,913 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:39,913 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,913 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:39,915 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,915 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,915 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:39,915 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:39,915 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:39,915 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:39,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,917 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,917 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:39,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:39,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:39,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:39,924 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:39,924 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:39,924 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:39,924 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:40,024 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:40,025 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:40,028 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:40,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:40,030 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,030 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:40,030 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:40,030 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:40,030 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:40,031 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,031 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,032 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,032 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:40,032 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:40,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:40,032 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,032 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,033 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:40,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,033 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,033 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:55:40,033 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,033 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:40,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:40,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:40,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:40,034 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:40,034 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:40,034 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:40,034 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:55:40,180 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:55:40,444 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201512310ca8c267e81548b59b1342647c8b2b7f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310ca8c267e81548b59b1342647c8b2b7f 2023-11-30 20:55:40,849 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=25, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/798836123b4e4872a37f6eb381581d7a 2023-11-30 20:55:40,853 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/798836123b4e4872a37f6eb381581d7a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/798836123b4e4872a37f6eb381581d7a 2023-11-30 20:55:40,856 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/798836123b4e4872a37f6eb381581d7a, entries=1, sequenceid=25, filesize=4.9 K 2023-11-30 20:55:40,857 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 823ms, sequenceid=25, compaction requested=true 2023-11-30 20:55:40,857 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:40,857 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:40,857 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:40,857 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:40,857 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,857 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:40,857 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:40,860 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,860 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:40,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:40,860 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,860 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:40,860 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:40,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:40,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,861 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:40,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:40,862 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@c1eb523[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:40,862 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:40,862 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,863 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,863 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,863 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:40,863 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:40,863 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,863 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:40,867 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:40,867 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,867 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:40,867 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:40,867 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,868 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,869 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:40,869 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:40,869 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:40,869 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:40,869 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:40,869 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,869 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:40,872 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,872 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,872 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:40,872 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:40,872 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:40,873 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,873 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,874 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:40,874 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,875 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,876 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,876 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:40,876 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,876 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:40,876 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,876 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:40,876 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:40,876 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,876 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:40,876 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:40,876 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:40,876 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,876 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:55:40,876 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,876 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,877 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:40,877 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:40,877 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:40,877 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:40,977 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:40,978 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:40,981 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:40,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:40,983 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,983 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:40,983 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:40,983 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:40,983 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:40,983 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,983 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,984 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:40,984 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,984 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:40,985 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:40,985 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,985 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,985 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:40,986 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,986 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,986 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:55:40,986 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:40,986 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:40,986 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:40,986 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:40,986 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:40,986 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:40,986 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:40,986 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:40,986 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:55:41,399 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160101dfffba49a793402988922b135fa47aec to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101dfffba49a793402988922b135fa47aec 2023-11-30 20:55:41,404 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=29, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/215e7e465ce541d1a57c64cae572ace6 2023-11-30 20:55:41,409 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/215e7e465ce541d1a57c64cae572ace6 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/215e7e465ce541d1a57c64cae572ace6 2023-11-30 20:55:41,412 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/215e7e465ce541d1a57c64cae572ace6, entries=1, sequenceid=29, filesize=4.9 K 2023-11-30 20:55:41,413 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 427ms, sequenceid=29, compaction requested=true 2023-11-30 20:55:41,413 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:41,413 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:41,413 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:41,413 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:41,413 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,413 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:41,413 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:41,416 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,416 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:41,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:41,416 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,416 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:41,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:41,416 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:41,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,417 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:41,417 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:41,418 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@4c698cf8[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:41,418 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:41,418 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,419 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,419 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,419 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,419 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:41,419 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:41,419 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:41,419 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,419 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:41,421 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:41,421 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,421 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:41,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:41,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:41,421 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:41,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:41,421 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:41,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:41,422 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,423 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:41,423 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:41,423 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:41,423 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:41,423 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:41,423 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,423 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:41,425 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,425 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:41,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:41,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,425 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:41,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:41,425 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:41,425 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:41,425 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:41,426 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,427 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:41,427 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,428 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,429 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:41,430 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:55:41,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:41,430 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:41,430 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:41,430 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:41,430 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:41,430 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:41,530 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:41,531 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:41,535 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:41,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:41,536 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,536 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:41,536 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:41,537 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:41,537 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:41,537 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,537 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,538 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,538 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:41,538 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:41,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:41,539 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,539 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,539 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:41,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,539 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,540 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:55:41,540 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:41,540 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:41,540 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:41,540 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:41,540 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:55:41,952 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20160103982c2906f01c469c94fc637db6440278 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103982c2906f01c469c94fc637db6440278 2023-11-30 20:55:41,957 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=33, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/4980b6b3380d41e484625e7d8d9bd6b9 2023-11-30 20:55:41,960 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/4980b6b3380d41e484625e7d8d9bd6b9 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/4980b6b3380d41e484625e7d8d9bd6b9 2023-11-30 20:55:41,964 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/4980b6b3380d41e484625e7d8d9bd6b9, entries=1, sequenceid=33, filesize=4.9 K 2023-11-30 20:55:41,964 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 424ms, sequenceid=33, compaction requested=true 2023-11-30 20:55:41,964 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:41,964 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:41,964 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:41,965 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:41,965 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,965 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:41,965 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:41,966 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,967 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:41,967 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,967 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:41,967 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,968 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:41,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:41,968 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@1f56735d[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:41,968 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:41,968 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,971 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,971 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,971 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,971 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:41,971 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:41,971 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:41,971 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,971 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:41,973 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:41,973 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:41,973 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:41,974 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,975 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:41,975 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:41,975 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:41,975 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:41,975 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:41,975 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,975 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:41,977 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,977 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:41,977 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,977 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,977 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:41,978 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,978 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,978 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,979 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,979 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,980 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,981 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,981 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,981 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,981 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:41,981 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:41,982 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:41,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:41,982 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:55:41,982 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:41,982 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:41,982 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:41,982 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:41,982 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,982 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:41,982 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:41,982 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,982 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:41,987 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:41,987 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:42,087 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:42,088 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:42,092 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:42,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:42,097 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,097 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:42,097 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:42,097 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:42,097 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:42,098 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,098 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,100 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,100 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:42,100 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:42,100 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,100 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:42,100 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,101 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:42,101 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,101 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,101 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:55:42,101 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,101 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:42,102 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:42,102 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:42,102 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:42,102 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:42,102 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:42,102 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:42,102 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:55:42,514 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201509078852f10c97be4336adcc6d98c2efd355 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201509078852f10c97be4336adcc6d98c2efd355 2023-11-30 20:55:42,519 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=37, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/93b599f6fe63491b97c1f14a5b3f1f9f 2023-11-30 20:55:42,523 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/93b599f6fe63491b97c1f14a5b3f1f9f as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/93b599f6fe63491b97c1f14a5b3f1f9f 2023-11-30 20:55:42,527 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/93b599f6fe63491b97c1f14a5b3f1f9f, entries=1, sequenceid=37, filesize=4.9 K 2023-11-30 20:55:42,528 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 426ms, sequenceid=37, compaction requested=true 2023-11-30 20:55:42,528 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:42,528 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:42,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:42,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:42,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:42,528 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:42,533 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,533 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:42,533 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:42,533 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,533 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,534 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,535 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:42,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:42,535 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@29545710[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:42,535 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:42,535 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,536 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,536 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,536 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,536 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:42,536 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:42,537 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:42,537 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,537 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:42,538 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:42,538 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,538 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:42,538 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:42,538 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:42,539 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,540 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,541 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:42,541 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:42,541 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:42,541 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:42,541 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:42,541 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,541 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:42,544 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,544 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,544 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:42,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:42,544 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:42,544 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:42,545 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,545 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,545 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,546 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,546 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,547 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,548 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,548 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,548 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:42,548 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,548 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:42,548 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:42,548 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:42,548 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,548 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:42,548 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:42,548 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,549 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:55:42,549 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:42,549 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,549 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:42,549 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,549 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:42,549 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:42,649 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:42,650 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:42,655 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:42,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMinorCompactionWithMonthlyPolicy was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:42,656 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,656 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:42,657 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:42,657 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' 2023-11-30 20:55:42,657 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMinorCompactionWithMonthlyPolicy', kicking off acquire phase on members. 2023-11-30 20:55:42,657 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,657 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,658 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:42,658 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:42,658 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:42,659 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,659 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:42,659 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,660 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:42,660 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,660 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,660 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMinorCompactionWithMonthlyPolicy is still present, removing 2023-11-30 20:55:42,660 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,660 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMinorCompactionWithMonthlyPolicy' with timeout 60000ms 2023-11-30 20:55:42,661 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:42,661 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMinorCompactionWithMonthlyPolicy' starting 'acquire' stage 2023-11-30 20:55:42,663 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 1 regions 2023-11-30 20:55:42,663 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:42,663 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:42,663 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. started... 2023-11-30 20:55:42,663 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 691aa403271da0d28d3018e7aaa1107d 1/1 column families, dataSize=73 B heapSize=408 B 2023-11-30 20:55:42,682 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151120045ef94b66634398bf07ff5340b56e3e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120045ef94b66634398bf07ff5340b56e3e 2023-11-30 20:55:42,694 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=41, memsize=73, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/e9bd5ab401f54c5c877c97d4d711726d 2023-11-30 20:55:42,698 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/e9bd5ab401f54c5c877c97d4d711726d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/e9bd5ab401f54c5c877c97d4d711726d 2023-11-30 20:55:42,701 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/e9bd5ab401f54c5c877c97d4d711726d, entries=1, sequenceid=41, filesize=4.9 K 2023-11-30 20:55:42,702 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~73 B/73, heapSize ~392 B/392, currentSize=0 B/0 for 691aa403271da0d28d3018e7aaa1107d in 39ms, sequenceid=41, compaction requested=true 2023-11-30 20:55:42,702 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:42,702 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:42,702 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/1 local region flush tasks. 2023-11-30 20:55:42,702 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 1 local region flush tasks. 2023-11-30 20:55:42,702 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,702 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally acquired 2023-11-30 20:55:42,702 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMinorCompactionWithMonthlyPolicy) in zk 2023-11-30 20:55:42,706 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,706 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:42,706 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,706 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMinorCompactionWithMonthlyPolicy' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:42,706 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,707 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:42,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMinorCompactionWithMonthlyPolicy' on coordinator 2023-11-30 20:55:42,708 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@501a58b4[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:42,708 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMinorCompactionWithMonthlyPolicy' starting 'in-barrier' execution. 2023-11-30 20:55:42,708 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,710 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,710 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,711 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,711 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMinorCompactionWithMonthlyPolicy' received 'reached' from coordinator. 2023-11-30 20:55:42,711 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMinorCompactionWithMonthlyPolicy' locally completed 2023-11-30 20:55:42,711 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,711 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:42,711 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMinorCompactionWithMonthlyPolicy' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:42,712 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMinorCompactionWithMonthlyPolicy' has notified controller of completion 2023-11-30 20:55:42,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:42,712 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMinorCompactionWithMonthlyPolicy' completed. 2023-11-30 20:55:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:42,713 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:42,714 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,715 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMinorCompactionWithMonthlyPolicy' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:42,715 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMinorCompactionWithMonthlyPolicy', counting down latch. Waiting for 0 more 2023-11-30 20:55:42,715 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMinorCompactionWithMonthlyPolicy' execution completed 2023-11-30 20:55:42,715 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:42,715 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:42,715 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,715 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMinorCompactionWithMonthlyPolicyincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:42,717 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,717 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,717 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:42,717 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:42,717 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:42,718 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:42,718 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,718 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,719 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,719 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:42,720 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,721 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,722 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,722 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,722 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,722 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:42,722 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:42,722 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:42,722 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:42,722 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:42,722 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMinorCompactionWithMonthlyPolicy' 2023-11-30 20:55:42,722 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:42,722 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,722 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,722 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,722 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:42,723 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMinorCompactionWithMonthlyPolicy'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:42,723 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMinorCompactionWithMonthlyPolicy because node does not exist (not an error) 2023-11-30 20:55:42,723 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:42,723 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:42,723 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:42,823 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:42,824 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:42,825 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', MOB_THRESHOLD => '10', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536', MOB_COMPACT_PARTITION_POLICY => 'MONTHLY'}] of the table testMinorCompactionWithMonthlyPolicy 2023-11-30 20:55:42,827 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:55:42,828 DEBUG [PEWorker-4] locking.LockProcedure(309): LOCKED pid=115, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:55:42,828 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:55:42,828 INFO [PEWorker-4] procedure2.TimeoutExecutorThread(81): ADDED pid=115, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378342828 2023-11-30 20:55:42,829 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: false 2023-11-30 20:55:42,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 0 del files, 10 selected files, and 0 irrelevant files table 'testMinorCompactionWithMonthlyPolicy' and column 'family1' 2023-11-30 20:55:42,830 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 0 del files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:55:42,831 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x50381709 to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:55:42,836 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@425214d5, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:55:42,836 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:55:43,669 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e201601037c3ee1af251f4289ab8f3d19bc690f85 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201601037c3ee1af251f4289ab8f3d19bc690f85 2023-11-30 20:55:43,670 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:55:43,683 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:55:43,685 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:40002, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:55:43,691 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:55:43,692 INFO [RS-EventLoopGroup-1-1] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:56264, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:55:43,700 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/61a3d1d32fe545b590c005e3d7e19e19 first=Optional[r5] last=Optional[r6] 2023-11-30 20:55:43,700 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/61a3d1d32fe545b590c005e3d7e19e19}] 2023-11-30 20:55:43,705 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/61a3d1d32fe545b590c005e3d7e19e19 for inclusion in 691aa403271da0d28d3018e7aaa1107d/family1 2023-11-30 20:55:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r5 last=r6 2023-11-30 20:55:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:55:43,707 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:43,708 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101/family1/61a3d1d32fe545b590c005e3d7e19e19 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k0v1k1acgtqafslsmfj9c1lkgbbmmic72sqvo2c1huimo3v2c0ngl59a78pr00i4/family1/61a3d1d32fe545b590c005e3d7e19e19 2023-11-30 20:55:43,710 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k0v1k1acgtqafslsmfj9c1lkgbbmmic72sqvo2c1huimo3v2c0ngl59a78pr00i4/family1/61a3d1d32fe545b590c005e3d7e19e19 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/3145292be622460c93e72605ba90ecca_SeqId_44_ 2023-11-30 20:55:43,710 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k0v1k1acgtqafslsmfj9c1lkgbbmmic72sqvo2c1huimo3v2c0ngl59a78pr00i4/family1/61a3d1d32fe545b590c005e3d7e19e19 into 691aa403271da0d28d3018e7aaa1107d/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/3145292be622460c93e72605ba90ecca_SeqId_44_ - updating store file list. 2023-11-30 20:55:43,713 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/3145292be622460c93e72605ba90ecca_SeqId_44_ into 691aa403271da0d28d3018e7aaa1107d/family1 2023-11-30 20:55:43,713 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k0v1k1acgtqafslsmfj9c1lkgbbmmic72sqvo2c1huimo3v2c0ngl59a78pr00i4/family1/61a3d1d32fe545b590c005e3d7e19e19 into 691aa403271da0d28d3018e7aaa1107d/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/3145292be622460c93e72605ba90ecca_SeqId_44_) 2023-11-30 20:55:43,713 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__k0v1k1acgtqafslsmfj9c1lkgbbmmic72sqvo2c1huimo3v2c0ngl59a78pr00i4/family1/61a3d1d32fe545b590c005e3d7e19e19 2023-11-30 20:55:43,714 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 11 store files, 0 compacting, 11 eligible, 16 blocking 2023-11-30 20:55:43,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 10 files of size 50903 starting at candidate #1 after considering 44 permutations with 44 in ratio 2023-11-30 20:55:43,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(1912): 691aa403271da0d28d3018e7aaa1107d/family1 is initiating minor compaction 2023-11-30 20:55:43,716 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@48ce59d3; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:55:43,716 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 691aa403271da0d28d3018e7aaa1107d/family1 in testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:43,717 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/230c72bf0ec54998924e54b3f246f8a9, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/c5633f82bba243959d49370856277186, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/932b4ba6c4f14d9abd2260193605bc47, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/2311fc48d9d547b2b0224ef93c78c896, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/798836123b4e4872a37f6eb381581d7a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/215e7e465ce541d1a57c64cae572ace6, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/4980b6b3380d41e484625e7d8d9bd6b9, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/93b599f6fe63491b97c1f14a5b3f1f9f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/e9bd5ab401f54c5c877c97d4d711726d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/3145292be622460c93e72605ba90ecca_SeqId_44_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp, totalSize=49.7 K 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 230c72bf0ec54998924e54b3f246f8a9, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=9 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting c5633f82bba243959d49370856277186, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=13 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 932b4ba6c4f14d9abd2260193605bc47, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=17 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 2311fc48d9d547b2b0224ef93c78c896, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=21 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 798836123b4e4872a37f6eb381581d7a, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=25 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 215e7e465ce541d1a57c64cae572ace6, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=29 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 4980b6b3380d41e484625e7d8d9bd6b9, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=33 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 93b599f6fe63491b97c1f14a5b3f1f9f, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=37 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting e9bd5ab401f54c5c877c97d4d711726d, keycount=1, bloomtype=ROW, size=4.9 K, encoding=NONE, compression=NONE, seqNum=41 2023-11-30 20:55:43,717 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 3145292be622460c93e72605ba90ecca_SeqId_44_, keycount=2, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=45 2023-11-30 20:55:43,720 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20160101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:55:43,724 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:43,740 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101dfffba49a793402988922b135fa47aec to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160101dfffba49a793402988922b135fa47aec 2023-11-30 20:55:43,745 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103982c2906f01c469c94fc637db6440278 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20160103982c2906f01c469c94fc637db6440278 2023-11-30 20:55:43,745 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 2 expired mob files are deleted 2023-11-30 20:55:43,745 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20160101' 2023-11-30 20:55:43,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 2 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20160101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:55:43,746 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:55:43,785 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 691aa403271da0d28d3018e7aaa1107d#family1#compaction#166 average throughput is 0.17 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:44,227 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/0b33ab0d4c864026b9b06f1051072f5f as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/0b33ab0d4c864026b9b06f1051072f5f 2023-11-30 20:55:44,231 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 10 file(s) in 691aa403271da0d28d3018e7aaa1107d/family1 of 691aa403271da0d28d3018e7aaa1107d into 0b33ab0d4c864026b9b06f1051072f5f(size=6.6 K), total size for store is 172.6 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:44,231 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:44,231 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d., storeName=family1, fileCount=10, fileSize=49.7 K (5.0 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 4.9 K, 5.2 K), priority=2, time=1701377743716; duration=0sec 2023-11-30 20:55:44,231 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:55:44,245 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20151231d861de30d54349b28ba9ec16a5957830 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151231d861de30d54349b28ba9ec16a5957830 2023-11-30 20:55:44,245 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:55:44,266 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/17a66421660240f8b15a7e24287eb036 first=Optional[r1] last=Optional[r4] 2023-11-30 20:55:44,267 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/17a66421660240f8b15a7e24287eb036}] 2023-11-30 20:55:44,268 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/17a66421660240f8b15a7e24287eb036 for inclusion in 691aa403271da0d28d3018e7aaa1107d/family1 2023-11-30 20:55:44,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r1 last=r4 2023-11-30 20:55:44,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:55:44,270 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:44,271 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201/family1/17a66421660240f8b15a7e24287eb036 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__eur910h80to77lfeph488181uhfemtqbleecfkpug4q5i1p2kq1mmb8k1u54a1em/family1/17a66421660240f8b15a7e24287eb036 2023-11-30 20:55:44,273 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__eur910h80to77lfeph488181uhfemtqbleecfkpug4q5i1p2kq1mmb8k1u54a1em/family1/17a66421660240f8b15a7e24287eb036 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/655c6dc34bc946ef9bbc836cc85f84c1_SeqId_47_ 2023-11-30 20:55:44,274 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__eur910h80to77lfeph488181uhfemtqbleecfkpug4q5i1p2kq1mmb8k1u54a1em/family1/17a66421660240f8b15a7e24287eb036 into 691aa403271da0d28d3018e7aaa1107d/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/655c6dc34bc946ef9bbc836cc85f84c1_SeqId_47_ - updating store file list. 2023-11-30 20:55:44,278 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/655c6dc34bc946ef9bbc836cc85f84c1_SeqId_47_ into 691aa403271da0d28d3018e7aaa1107d/family1 2023-11-30 20:55:44,278 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__eur910h80to77lfeph488181uhfemtqbleecfkpug4q5i1p2kq1mmb8k1u54a1em/family1/17a66421660240f8b15a7e24287eb036 into 691aa403271da0d28d3018e7aaa1107d/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/655c6dc34bc946ef9bbc836cc85f84c1_SeqId_47_) 2023-11-30 20:55:44,278 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__eur910h80to77lfeph488181uhfemtqbleecfkpug4q5i1p2kq1mmb8k1u54a1em/family1/17a66421660240f8b15a7e24287eb036 2023-11-30 20:55:44,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] compactions.SortedCompactionPolicy(75): Selecting compaction from 3 store files, 0 compacting, 3 eligible, 16 blocking 2023-11-30 20:55:44,279 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] compactions.ExploringCompactionPolicy(116): Exploring compaction algorithm has selected 3 files of size 182349 starting at candidate #0 after considering 1 permutations with 1 in ratio 2023-11-30 20:55:44,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(1912): 691aa403271da0d28d3018e7aaa1107d/family1 is initiating minor compaction (all files) 2023-11-30 20:55:44,280 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.CompactSplit(385): Small Compaction requested: org.apache.hadoop.hbase.regionserver.DefaultStoreEngine$DefaultCompactionContext@659306f4; Because: bulkload hfiles request compaction; compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:55:44,280 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2259): Starting compaction of 691aa403271da0d28d3018e7aaa1107d/family1 in testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:55:44,280 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/897d6e9e80604341b59364f61e43eacf, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/0b33ab0d4c864026b9b06f1051072f5f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/655c6dc34bc946ef9bbc836cc85f84c1_SeqId_47_] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp, totalSize=178.1 K 2023-11-30 20:55:44,280 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 897d6e9e80604341b59364f61e43eacf, keycount=1000, bloomtype=ROW, size=166.0 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1448878824433 2023-11-30 20:55:44,281 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 0b33ab0d4c864026b9b06f1051072f5f, keycount=9, bloomtype=ROW, size=6.6 K, encoding=NONE, compression=NONE, seqNum=45, earliestPutTs=1441621224433 2023-11-30 20:55:44,281 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] compactions.Compactor(207): Compacting 655c6dc34bc946ef9bbc836cc85f84c1_SeqId_47_, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=48, earliestPutTs=1448965224433 2023-11-30 20:55:44,282 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151201 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:55:44,282 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:44,283 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512017d65661c79034cf8b07eb9ab534b554a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512017d65661c79034cf8b07eb9ab534b554a 2023-11-30 20:55:44,285 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120573b915b565bc484cbb4478876953a514 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015120573b915b565bc484cbb4478876953a514 2023-11-30 20:55:44,286 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284baa324bb0d247b98a890d9982b8a633 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512284baa324bb0d247b98a890d9982b8a633 2023-11-30 20:55:44,287 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310ca8c267e81548b59b1342647c8b2b7f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e201512310ca8c267e81548b59b1342647c8b2b7f 2023-11-30 20:55:44,287 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 4 expired mob files are deleted 2023-11-30 20:55:44,287 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151201' 2023-11-30 20:55:44,288 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151201 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:55:44,288 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:55:44,298 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] throttle.PressureAwareThroughputController(145): 691aa403271da0d28d3018e7aaa1107d#family1#compaction#167 average throughput is 15.56 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:44,304 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/230c72bf0ec54998924e54b3f246f8a9, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/c5633f82bba243959d49370856277186, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/932b4ba6c4f14d9abd2260193605bc47, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/2311fc48d9d547b2b0224ef93c78c896, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/798836123b4e4872a37f6eb381581d7a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/215e7e465ce541d1a57c64cae572ace6, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/4980b6b3380d41e484625e7d8d9bd6b9, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/93b599f6fe63491b97c1f14a5b3f1f9f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/e9bd5ab401f54c5c877c97d4d711726d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/3145292be622460c93e72605ba90ecca_SeqId_44_] to archive 2023-11-30 20:55:44,305 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:44,307 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/230c72bf0ec54998924e54b3f246f8a9 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/230c72bf0ec54998924e54b3f246f8a9 2023-11-30 20:55:44,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/c5633f82bba243959d49370856277186 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/c5633f82bba243959d49370856277186 2023-11-30 20:55:44,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/932b4ba6c4f14d9abd2260193605bc47 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/932b4ba6c4f14d9abd2260193605bc47 2023-11-30 20:55:44,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/2311fc48d9d547b2b0224ef93c78c896 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/2311fc48d9d547b2b0224ef93c78c896 2023-11-30 20:55:44,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/798836123b4e4872a37f6eb381581d7a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/798836123b4e4872a37f6eb381581d7a 2023-11-30 20:55:44,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/215e7e465ce541d1a57c64cae572ace6 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/215e7e465ce541d1a57c64cae572ace6 2023-11-30 20:55:44,316 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/4980b6b3380d41e484625e7d8d9bd6b9 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/4980b6b3380d41e484625e7d8d9bd6b9 2023-11-30 20:55:44,317 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/93b599f6fe63491b97c1f14a5b3f1f9f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/93b599f6fe63491b97c1f14a5b3f1f9f 2023-11-30 20:55:44,320 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/e9bd5ab401f54c5c877c97d4d711726d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/e9bd5ab401f54c5c877c97d4d711726d 2023-11-30 20:55:44,321 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/3145292be622460c93e72605ba90ecca_SeqId_44_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/3145292be622460c93e72605ba90ecca_SeqId_44_ 2023-11-30 20:55:44,345 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/.tmp/family1/8aaaac0133124df5a3a970f44ebe7677 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/8aaaac0133124df5a3a970f44ebe7677 2023-11-30 20:55:44,364 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HStore(1652): Completed compaction of 3 (all) file(s) in 691aa403271da0d28d3018e7aaa1107d/family1 of 691aa403271da0d28d3018e7aaa1107d into 8aaaac0133124df5a3a970f44ebe7677(size=167.4 K), total size for store is 167.4 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:44,364 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.HRegion(2289): Compaction status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:44,364 INFO [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(627): Completed compaction Request=regionName=testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d., storeName=family1, fileCount=3, fileSize=178.1 K (166.0 K, 6.6 K, 5.5 K), priority=2, time=1701377744280; duration=0sec 2023-11-30 20:55:44,364 DEBUG [RS:0;jenkins-hbase4:40365-shortCompactions-0] regionserver.CompactSplit$CompactionRunner(659): Status compactionQueue=(longCompactions=0:shortCompactions=0), splitQueue=0 2023-11-30 20:55:44,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/897d6e9e80604341b59364f61e43eacf, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/0b33ab0d4c864026b9b06f1051072f5f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/655c6dc34bc946ef9bbc836cc85f84c1_SeqId_47_] to archive 2023-11-30 20:55:44,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:44,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/897d6e9e80604341b59364f61e43eacf to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/897d6e9e80604341b59364f61e43eacf 2023-11-30 20:55:44,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/0b33ab0d4c864026b9b06f1051072f5f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/0b33ab0d4c864026b9b06f1051072f5f 2023-11-30 20:55:44,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/655c6dc34bc946ef9bbc836cc85f84c1_SeqId_47_ to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/655c6dc34bc946ef9bbc836cc85f84c1_SeqId_47_ 2023-11-30 20:55:44,750 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2015113087975aa59e2a46d2bcb95e796a651362 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015113087975aa59e2a46d2bcb95e796a651362 2023-11-30 20:55:44,751 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:55:44,776 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a95804067643410cb225c490d51f5bc8 first=Optional[r00] last=Optional[r8] 2023-11-30 20:55:44,777 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a95804067643410cb225c490d51f5bc8}] 2023-11-30 20:55:44,779 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a95804067643410cb225c490d51f5bc8 for inclusion in 691aa403271da0d28d3018e7aaa1107d/family1 2023-11-30 20:55:44,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=r00 last=r8 2023-11-30 20:55:44,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last= 2023-11-30 20:55:44,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:55:44,781 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101/family1/a95804067643410cb225c490d51f5bc8 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p8vafeiftp609p70rh4b2h4g9aqo37lnsb2k4tro9cndk6kt72e2kerc3jid1p58/family1/a95804067643410cb225c490d51f5bc8 2023-11-30 20:55:44,783 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p8vafeiftp609p70rh4b2h4g9aqo37lnsb2k4tro9cndk6kt72e2kerc3jid1p58/family1/a95804067643410cb225c490d51f5bc8 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/ebc5a859a5d84e45b1e0441b69fab7b1_SeqId_50_ 2023-11-30 20:55:44,784 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p8vafeiftp609p70rh4b2h4g9aqo37lnsb2k4tro9cndk6kt72e2kerc3jid1p58/family1/a95804067643410cb225c490d51f5bc8 into 691aa403271da0d28d3018e7aaa1107d/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/ebc5a859a5d84e45b1e0441b69fab7b1_SeqId_50_ - updating store file list. 2023-11-30 20:55:44,786 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/ebc5a859a5d84e45b1e0441b69fab7b1_SeqId_50_ into 691aa403271da0d28d3018e7aaa1107d/family1 2023-11-30 20:55:44,787 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p8vafeiftp609p70rh4b2h4g9aqo37lnsb2k4tro9cndk6kt72e2kerc3jid1p58/family1/a95804067643410cb225c490d51f5bc8 into 691aa403271da0d28d3018e7aaa1107d/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/family1/ebc5a859a5d84e45b1e0441b69fab7b1_SeqId_50_) 2023-11-30 20:55:44,787 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMinorCompactionWithMonthlyPolicy__p8vafeiftp609p70rh4b2h4g9aqo37lnsb2k4tro9cndk6kt72e2kerc3jid1p58/family1/a95804067643410cb225c490d51f5bc8 2023-11-30 20:55:44,789 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20151101 table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:55:44,789 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:44,791 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120045ef94b66634398bf07ff5340b56e3e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151120045ef94b66634398bf07ff5340b56e3e 2023-11-30 20:55:44,792 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112867561bc9873a44cd8a78625ee18500bb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e2015112867561bc9873a44cd8a78625ee18500bb 2023-11-30 20:55:44,793 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a1f47b6ecaf74ecfad0754696f92e123 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMinorCompactionWithMonthlyPolicy/a99017e1e6e4950136225669515fd1e8/family1/d41d8cd98f00b204e9800998ecf8427e20151130a1f47b6ecaf74ecfad0754696f92e123 2023-11-30 20:55:44,793 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMinorCompactionWithMonthlyPolicy 3 expired mob files are deleted 2023-11-30 20:55:44,793 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMinorCompactionWithMonthlyPolicy/d41d8cd98f00b204e9800998ecf8427e20151101' 2023-11-30 20:55:44,794 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 3 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20151101 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:55:44,794 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:55:44,794 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 1 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20150901 for table='testMinorCompactionWithMonthlyPolicy' and column='family1' 2023-11-30 20:55:44,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 4 mob files. table='testMinorCompactionWithMonthlyPolicy' column='family1' 2023-11-30 20:55:44,794 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMinorCompactionWithMonthlyPolicy', column='family1', allFiles=false, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:55:44,796 DEBUG [PEWorker-3] locking.LockProcedure(242): UNLOCKED pid=115, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE 2023-11-30 20:55:44,797 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=115, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMinorCompactionWithMonthlyPolicy.mobLock, type=EXCLUSIVE in 1.9700 sec 2023-11-30 20:55:45,031 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMinorCompactionWithMonthlyPolicy Thread=261 (was 251) - Thread LEAK? -, OpenFileDescriptor=678 (was 655) - OpenFileDescriptor LEAK? -, MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=181 (was 186), ProcessCount=172 (was 172), AvailableMemoryMB=7668 (was 7514) - AvailableMemoryMB LEAK? - 2023-11-30 20:55:45,047 INFO [Listener at localhost/34291] hbase.ResourceChecker(147): before: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=261, OpenFileDescriptor=678, MaxFileDescriptor=60000, SystemLoadAverage=181, ProcessCount=172, AvailableMemoryMB=7667 2023-11-30 20:55:45,069 DEBUG [Listener at localhost/34291] crypto.Encryption(565): Installed org.apache.hadoop.hbase.io.crypto.KeyProviderForTesting into key provider cache 2023-11-30 20:55:45,148 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.HMaster$4(2112): Client=jenkins//172.31.14.131 create 'testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE6n`T\xB2\xBCz\xEC\xED\xB0\xEF{\xADQ\x12\x83"\x10\xC1\x12l\x9De\x12t\x8EKB")\x98gTZ*\x10\xC9z\x09\xDAl\xF3\xDEB_\x18H\xA96\x0D\x18\xA52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'} 2023-11-30 20:55:45,149 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure2.ProcedureExecutor(1075): Stored pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION; CreateTableProcedure table=testMajorCompactionFromAdmin 2023-11-30 20:55:45,151 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_PRE_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_PRE_OPERATION 2023-11-30 20:55:45,151 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(700): Client=jenkins//172.31.14.131 procedure request for creating table: namespace: "default" qualifier: "testMajorCompactionFromAdmin" procId is: 116 2023-11-30 20:55:45,151 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_WRITE_FS_LAYOUT, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_WRITE_FS_LAYOUT 2023-11-30 20:55:45,152 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-30 20:55:45,153 DEBUG [HFileArchiver-20] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:45,153 DEBUG [HFileArchiver-21] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:45,153 DEBUG [HFileArchiver-22] backup.HFileArchiver(131): ARCHIVING hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:45,154 DEBUG [HFileArchiver-20] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7 empty. 2023-11-30 20:55:45,154 DEBUG [HFileArchiver-21] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18 empty. 2023-11-30 20:55:45,154 DEBUG [HFileArchiver-22] backup.HFileArchiver(153): Directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677 empty. 2023-11-30 20:55:45,154 DEBUG [HFileArchiver-20] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:45,154 DEBUG [HFileArchiver-22] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:45,154 DEBUG [HFileArchiver-21] backup.HFileArchiver(599): Failed to delete directory hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:45,155 DEBUG [PEWorker-1] procedure.DeleteTableProcedure(328): Archived testMajorCompactionFromAdmin regions 2023-11-30 20:55:45,253 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-30 20:55:45,454 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-30 20:55:45,563 DEBUG [PEWorker-1] util.FSTableDescriptors(570): Wrote into hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp/data/default/testMajorCompactionFromAdmin/.tabledesc/.tableinfo.0000000001 2023-11-30 20:55:45,565 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(7675): creating {ENCODED => ac7a1c004e53268e4385b265a4168677, NAME => 'testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677.', STARTKEY => '2', ENDKEY => ''}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE6n`T\xB2\xBCz\xEC\xED\xB0\xEF{\xADQ\x12\x83"\x10\xC1\x12l\x9De\x12t\x8EKB")\x98gTZ*\x10\xC9z\x09\xDAl\xF3\xDEB_\x18H\xA96\x0D\x18\xA52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:55:45,565 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(7675): creating {ENCODED => 5c8e64d8810f3630e0dc789f524c2bd7, NAME => 'testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7.', STARTKEY => '', ENDKEY => '1'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE6n`T\xB2\xBCz\xEC\xED\xB0\xEF{\xADQ\x12\x83"\x10\xC1\x12l\x9De\x12t\x8EKB")\x98gTZ*\x10\xC9z\x09\xDAl\xF3\xDEB_\x18H\xA96\x0D\x18\xA52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:55:45,565 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(7675): creating {ENCODED => 3ba2330b8c4670c795e548e8c3f7ab18, NAME => 'testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18.', STARTKEY => '1', ENDKEY => '2'}, tableDescriptor='testMajorCompactionFromAdmin', {NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE6n`T\xB2\xBCz\xEC\xED\xB0\xEF{\xADQ\x12\x83"\x10\xC1\x12l\x9De\x12t\x8EKB")\x98gTZ*\x10\xC9z\x09\xDAl\xF3\xDEB_\x18H\xA96\x0D\x18\xA52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, {NAME => 'family2', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}, regionDir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/.tmp 2023-11-30 20:55:45,571 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:45,571 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1604): Closing 3ba2330b8c4670c795e548e8c3f7ab18, disabling compactions & flushes 2023-11-30 20:55:45,571 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:45,571 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:45,571 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. after waiting 0 ms 2023-11-30 20:55:45,571 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:45,571 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:45,571 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-1] regionserver.HRegion(1558): Region close journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:55:45,755 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-30 20:55:45,971 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:45,971 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:45,971 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1604): Closing ac7a1c004e53268e4385b265a4168677, disabling compactions & flushes 2023-11-30 20:55:45,972 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1604): Closing 5c8e64d8810f3630e0dc789f524c2bd7, disabling compactions & flushes 2023-11-30 20:55:45,972 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:45,972 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:45,972 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:45,972 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. after waiting 0 ms 2023-11-30 20:55:45,972 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:45,972 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:45,972 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-0] regionserver.HRegion(1558): Region close journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:55:45,972 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:45,972 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. after waiting 0 ms 2023-11-30 20:55:45,972 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:45,972 INFO [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:45,972 DEBUG [RegionOpenAndInit-testMajorCompactionFromAdmin-pool-2] regionserver.HRegion(1558): Region close journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:55:45,974 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ADD_TO_META, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ADD_TO_META 2023-11-30 20:55:45,975 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701377745975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377745975"}]},"ts":"1701377745975"} 2023-11-30 20:55:45,975 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377745975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377745975"}]},"ts":"1701377745975"} 2023-11-30 20:55:45,975 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":2,"row":"testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377745975"},{"qualifier":"state","vlen":6,"tag":[],"timestamp":"1701377745975"}]},"ts":"1701377745975"} 2023-11-30 20:55:45,977 INFO [PEWorker-1] hbase.MetaTableAccessor(1496): Added 3 regions to meta. 2023-11-30 20:55:45,978 INFO [PEWorker-1] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_ASSIGN_REGIONS, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_ASSIGN_REGIONS 2023-11-30 20:55:45,978 DEBUG [PEWorker-1] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377745978"}]},"ts":"1701377745978"} 2023-11-30 20:55:45,979 INFO [PEWorker-1] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLING in hbase:meta 2023-11-30 20:55:45,982 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5c8e64d8810f3630e0dc789f524c2bd7, ASSIGN}, {pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3ba2330b8c4670c795e548e8c3f7ab18, ASSIGN}, {pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ac7a1c004e53268e4385b265a4168677, ASSIGN}] 2023-11-30 20:55:45,983 INFO [PEWorker-2] procedure.MasterProcedureScheduler(727): Took xlock for pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ac7a1c004e53268e4385b265a4168677, ASSIGN 2023-11-30 20:55:45,983 INFO [PEWorker-5] procedure.MasterProcedureScheduler(727): Took xlock for pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3ba2330b8c4670c795e548e8c3f7ab18, ASSIGN 2023-11-30 20:55:45,983 INFO [PEWorker-4] procedure.MasterProcedureScheduler(727): Took xlock for pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5c8e64d8810f3630e0dc789f524c2bd7, ASSIGN 2023-11-30 20:55:45,983 INFO [PEWorker-2] assignment.TransitRegionStateProcedure(193): Starting pid=119, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ac7a1c004e53268e4385b265a4168677, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:55:45,983 INFO [PEWorker-4] assignment.TransitRegionStateProcedure(193): Starting pid=117, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5c8e64d8810f3630e0dc789f524c2bd7, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:55:45,983 INFO [PEWorker-5] assignment.TransitRegionStateProcedure(193): Starting pid=118, ppid=116, state=RUNNABLE:REGION_STATE_TRANSITION_GET_ASSIGN_CANDIDATE, locked=true; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3ba2330b8c4670c795e548e8c3f7ab18, ASSIGN; state=OFFLINE, location=jenkins-hbase4.apache.org,40365,1701377600631; forceNewPlan=false, retain=false 2023-11-30 20:55:46,135 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=3ba2330b8c4670c795e548e8c3f7ab18, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:46,135 INFO [PEWorker-1] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ac7a1c004e53268e4385b265a4168677, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:46,135 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=5c8e64d8810f3630e0dc789f524c2bd7, regionState=OPENING, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:46,135 DEBUG [PEWorker-1] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377746135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377746135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377746135"}]},"ts":"1701377746135"} 2023-11-30 20:55:46,135 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701377746135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377746135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377746135"}]},"ts":"1701377746135"} 2023-11-30 20:55:46,135 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":3,"row":"testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377746135"},{"qualifier":"sn","vlen":45,"tag":[],"timestamp":"1701377746135"},{"qualifier":"state","vlen":7,"tag":[],"timestamp":"1701377746135"}]},"ts":"1701377746135"} 2023-11-30 20:55:46,137 INFO [PEWorker-1] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=120, ppid=119, state=RUNNABLE; OpenRegionProcedure ac7a1c004e53268e4385b265a4168677, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:46,137 INFO [PEWorker-4] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=121, ppid=118, state=RUNNABLE; OpenRegionProcedure 3ba2330b8c4670c795e548e8c3f7ab18, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:46,138 INFO [PEWorker-3] procedure2.ProcedureExecutor(1796): Initialized subprocedures=[{pid=122, ppid=117, state=RUNNABLE; OpenRegionProcedure 5c8e64d8810f3630e0dc789f524c2bd7, server=jenkins-hbase4.apache.org,40365,1701377600631}] 2023-11-30 20:55:46,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-30 20:55:46,288 DEBUG [RSProcedureDispatcher-pool-2] master.ServerManager(702): New admin connection to jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:46,291 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:46,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 5c8e64d8810f3630e0dc789f524c2bd7, NAME => 'testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7.', STARTKEY => '', ENDKEY => '1'} 2023-11-30 20:55:46,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:46,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:46,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:46,292 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:46,315 INFO [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:46,317 DEBUG [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1 2023-11-30 20:55:46,317 DEBUG [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1 2023-11-30 20:55:46,318 INFO [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c8e64d8810f3630e0dc789f524c2bd7 columnFamilyName family1 2023-11-30 20:55:46,319 INFO [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] regionserver.HStore(310): Store=5c8e64d8810f3630e0dc789f524c2bd7/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:46,319 INFO [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:46,321 DEBUG [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2 2023-11-30 20:55:46,321 DEBUG [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2 2023-11-30 20:55:46,321 INFO [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 5c8e64d8810f3630e0dc789f524c2bd7 columnFamilyName family2 2023-11-30 20:55:46,322 INFO [StoreOpener-5c8e64d8810f3630e0dc789f524c2bd7-1] regionserver.HStore(310): Store=5c8e64d8810f3630e0dc789f524c2bd7/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:46,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:46,323 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:46,324 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:55:46,325 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:55:46,326 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:55:46,327 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 5c8e64d8810f3630e0dc789f524c2bd7; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=72258687, jitterRate=0.07673834264278412}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:55:46,327 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:55:46,328 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7., pid=122, masterSystemTime=1701377746288 2023-11-30 20:55:46,330 INFO [PEWorker-4] assignment.RegionStateStore(219): pid=117 updating hbase:meta row=5c8e64d8810f3630e0dc789f524c2bd7, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:46,331 DEBUG [PEWorker-4] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377746330"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377746330"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377746330"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377746330"}]},"ts":"1701377746330"} 2023-11-30 20:55:46,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:46,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:46,331 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:46,331 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => 3ba2330b8c4670c795e548e8c3f7ab18, NAME => 'testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18.', STARTKEY => '1', ENDKEY => '2'} 2023-11-30 20:55:46,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin 3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:46,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:46,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for 3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:46,332 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for 3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:46,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=122, resume processing ppid=117 2023-11-30 20:55:46,334 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=122, ppid=117, state=SUCCESS; OpenRegionProcedure 5c8e64d8810f3630e0dc789f524c2bd7, server=jenkins-hbase4.apache.org,40365,1701377600631 in 194 msec 2023-11-30 20:55:46,335 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=117, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=5c8e64d8810f3630e0dc789f524c2bd7, ASSIGN in 352 msec 2023-11-30 20:55:46,366 INFO [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region 3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:46,368 DEBUG [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1 2023-11-30 20:55:46,368 DEBUG [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1 2023-11-30 20:55:46,369 INFO [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ba2330b8c4670c795e548e8c3f7ab18 columnFamilyName family1 2023-11-30 20:55:46,369 INFO [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] regionserver.HStore(310): Store=3ba2330b8c4670c795e548e8c3f7ab18/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:46,370 INFO [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region 3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:46,371 DEBUG [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2 2023-11-30 20:55:46,371 DEBUG [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2 2023-11-30 20:55:46,371 INFO [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region 3ba2330b8c4670c795e548e8c3f7ab18 columnFamilyName family2 2023-11-30 20:55:46,372 INFO [StoreOpener-3ba2330b8c4670c795e548e8c3f7ab18-1] regionserver.HStore(310): Store=3ba2330b8c4670c795e548e8c3f7ab18/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:46,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:46,373 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:46,375 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:55:46,376 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for 3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:55:46,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:55:46,377 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened 3ba2330b8c4670c795e548e8c3f7ab18; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=73301850, jitterRate=0.09228268265724182}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:55:46,377 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:55:46,378 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18., pid=121, masterSystemTime=1701377746288 2023-11-30 20:55:46,379 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:46,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:46,379 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(130): Open testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:46,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7854): Opening region: {ENCODED => ac7a1c004e53268e4385b265a4168677, NAME => 'testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677.', STARTKEY => '2', ENDKEY => ''} 2023-11-30 20:55:46,380 INFO [PEWorker-3] assignment.RegionStateStore(219): pid=118 updating hbase:meta row=3ba2330b8c4670c795e548e8c3f7ab18, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:46,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.MetricsRegionSourceImpl(79): Creating new MetricsRegionSourceImpl for table testMajorCompactionFromAdmin ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:46,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(866): Instantiated testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677.; StoreHotnessProtector, parallelPutToStoreThreadLimit=10 ; minColumnNum=100 ; preparePutThreadLimit=20 ; hotProtect now enable 2023-11-30 20:55:46,380 DEBUG [PEWorker-3] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18.","families":{"info":[{"qualifier":"regioninfo","vlen":64,"tag":[],"timestamp":"1701377746380"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377746380"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377746380"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377746380"}]},"ts":"1701377746380"} 2023-11-30 20:55:46,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7894): checking encryption for ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:46,380 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(7897): checking classloading for ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:46,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=121, resume processing ppid=118 2023-11-30 20:55:46,383 INFO [PEWorker-3] procedure2.ProcedureExecutor(1457): Finished pid=121, ppid=118, state=SUCCESS; OpenRegionProcedure 3ba2330b8c4670c795e548e8c3f7ab18, server=jenkins-hbase4.apache.org,40365,1701377600631 in 244 msec 2023-11-30 20:55:46,384 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=118, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=3ba2330b8c4670c795e548e8c3f7ab18, ASSIGN in 401 msec 2023-11-30 20:55:46,401 INFO [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family1 of region ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:46,402 DEBUG [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1 2023-11-30 20:55:46,402 DEBUG [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1 2023-11-30 20:55:46,402 INFO [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac7a1c004e53268e4385b265a4168677 columnFamilyName family1 2023-11-30 20:55:46,403 INFO [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] regionserver.HStore(310): Store=ac7a1c004e53268e4385b265a4168677/family1, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:46,403 INFO [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] regionserver.HStore(381): Created cacheConfig: cacheDataOnRead=true, cacheDataOnWrite=false, cacheIndexesOnWrite=false, cacheBloomsOnWrite=false, cacheEvictOnClose=false, cacheDataCompressed=false, prefetchOnOpen=false, for column family family2 of region ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:46,404 DEBUG [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2 2023-11-30 20:55:46,404 DEBUG [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] util.CommonFSUtils(522): Set storagePolicy=HOT for path=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2 2023-11-30 20:55:46,405 INFO [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] compactions.CompactionConfiguration(173): size [minCompactSize:128 MB, maxCompactSize:8.00 EB, offPeakMaxCompactSize:8.00 EB); files [minFilesToCompact:3, maxFilesToCompact:10); ratio 1.200000; off-peak ratio 5.000000; throttle point 2684354560; major period 604800000, major jitter 0.500000, min locality to compact 0.000000; tiered compaction: max_age 9223372036854775807, incoming window min 6, compaction policy for tiered window org.apache.hadoop.hbase.regionserver.compactions.ExploringCompactionPolicy, single output for minor true, compaction window factory org.apache.hadoop.hbase.regionserver.compactions.ExponentialCompactionWindowFactory, region ac7a1c004e53268e4385b265a4168677 columnFamilyName family2 2023-11-30 20:55:46,405 INFO [StoreOpener-ac7a1c004e53268e4385b265a4168677-1] regionserver.HStore(310): Store=ac7a1c004e53268e4385b265a4168677/family2, memstore type=DefaultMemStore, storagePolicy=HOT, verifyBulkLoads=false, parallelPutCountPrintThreshold=50, encoding=NONE, compression=NONE 2023-11-30 20:55:46,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:46,406 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(5209): Found 0 recovered edits file(s) under hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:46,407 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.FlushLargeStoresPolicy(65): No hbase.hregion.percolumnfamilyflush.size.lower.bound set in table testMajorCompactionFromAdmin descriptor;using region.getMemStoreFlushHeapSize/# of families (64.0 M)) instead. 2023-11-30 20:55:46,408 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1055): writing seq id for ac7a1c004e53268e4385b265a4168677 2023-11-30 20:55:46,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/recovered.edits/1.seqid, newMaxSeqId=1, maxSeqId=-1 2023-11-30 20:55:46,410 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1072): Opened ac7a1c004e53268e4385b265a4168677; next sequenceid=2; SteppingSplitPolicysuper{IncreasingToUpperBoundRegionSplitPolicy{initialSize=268435456, ConstantSizeRegionSplitPolicy{desiredMaxFileSize=69917246, jitterRate=0.04184815287590027}}}, FlushLargeStoresPolicy{flushSizeLowerBound=67108864} 2023-11-30 20:55:46,410 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(965): Region open journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:55:46,411 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2339): Post open deploy tasks for testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677., pid=120, masterSystemTime=1701377746288 2023-11-30 20:55:46,412 DEBUG [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionServer(2366): Finished post open deploy task for testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:46,412 INFO [RS_OPEN_REGION-regionserver/jenkins-hbase4:0-0] handler.AssignRegionHandler(158): Opened testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:46,412 INFO [PEWorker-5] assignment.RegionStateStore(219): pid=119 updating hbase:meta row=ac7a1c004e53268e4385b265a4168677, regionState=OPEN, openSeqNum=2, regionLocation=jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:46,412 DEBUG [PEWorker-5] assignment.RegionStateStore(405): Put {"totalColumns":5,"row":"testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677.","families":{"info":[{"qualifier":"regioninfo","vlen":63,"tag":[],"timestamp":"1701377746412"},{"qualifier":"server","vlen":31,"tag":[],"timestamp":"1701377746412"},{"qualifier":"serverstartcode","vlen":8,"tag":[],"timestamp":"1701377746412"},{"qualifier":"seqnumDuringOpen","vlen":8,"tag":[],"timestamp":"1701377746412"}]},"ts":"1701377746412"} 2023-11-30 20:55:46,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=120, resume processing ppid=119 2023-11-30 20:55:46,415 INFO [PEWorker-5] procedure2.ProcedureExecutor(1457): Finished pid=120, ppid=119, state=SUCCESS; OpenRegionProcedure ac7a1c004e53268e4385b265a4168677, server=jenkins-hbase4.apache.org,40365,1701377600631 in 276 msec 2023-11-30 20:55:46,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1953): Finished subprocedure pid=119, resume processing ppid=116 2023-11-30 20:55:46,416 INFO [PEWorker-1] procedure2.ProcedureExecutor(1457): Finished pid=119, ppid=116, state=SUCCESS; TransitRegionStateProcedure table=testMajorCompactionFromAdmin, region=ac7a1c004e53268e4385b265a4168677, ASSIGN in 433 msec 2023-11-30 20:55:46,416 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_UPDATE_DESC_CACHE, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_UPDATE_DESC_CACHE 2023-11-30 20:55:46,417 DEBUG [PEWorker-4] hbase.MetaTableAccessor(2093): Put {"totalColumns":1,"row":"testMajorCompactionFromAdmin","families":{"table":[{"qualifier":"state","vlen":2,"tag":[],"timestamp":"1701377746417"}]},"ts":"1701377746417"} 2023-11-30 20:55:46,417 INFO [PEWorker-4] hbase.MetaTableAccessor(1635): Updated tableName=testMajorCompactionFromAdmin, state=ENABLED in hbase:meta 2023-11-30 20:55:46,420 INFO [PEWorker-4] procedure.CreateTableProcedure(80): pid=116, state=RUNNABLE:CREATE_TABLE_POST_OPERATION, locked=true; CreateTableProcedure table=testMajorCompactionFromAdmin execute state=CREATE_TABLE_POST_OPERATION 2023-11-30 20:55:46,421 INFO [PEWorker-4] procedure2.ProcedureExecutor(1457): Finished pid=116, state=SUCCESS; CreateTableProcedure table=testMajorCompactionFromAdmin in 1.2720 sec 2023-11-30 20:55:47,125 DEBUG [HBase-Metrics2-1] regionserver.MetricsTableSourceImpl(130): Creating new MetricsTableSourceImpl for table 'testMajorCompactionFromAdmin' 2023-11-30 20:55:47,256 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1230): Checking to see if procedure is done pid=116 2023-11-30 20:55:47,257 INFO [Listener at localhost/34291] client.HBaseAdmin$TableFuture(3541): Operation: CREATE, Table Name: default:testMajorCompactionFromAdmin, procId: 116 completed 2023-11-30 20:55:47,262 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:47,263 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:47,263 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:47,265 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:47,267 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-30 20:55:47,267 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-30 20:55:47,267 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:47,267 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-30 20:55:47,267 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-30 20:55:47,267 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:47,267 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:47,268 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:47,268 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:47,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:47,269 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:47,269 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:47,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:47,270 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:47,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:47,270 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:47,270 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-30 20:55:47,270 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-30 20:55:47,270 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-30 20:55:47,270 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:47,271 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-30 20:55:47,271 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:47,271 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. started... 2023-11-30 20:55:47,271 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:47,271 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:47,271 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:47,272 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5c8e64d8810f3630e0dc789f524c2bd7 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-30 20:55:47,272 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. started... 2023-11-30 20:55:47,271 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:47,272 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. started... 2023-11-30 20:55:47,272 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ac7a1c004e53268e4385b265a4168677 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-30 20:55:47,273 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3ba2330b8c4670c795e548e8c3f7ab18 2/2 column families, dataSize=342 B heapSize=1.27 KB 2023-11-30 20:55:47,322 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311309ef29f4722b04f52becca4a6e2c9f649 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311309ef29f4722b04f52becca4a6e2c9f649 2023-11-30 20:55:47,723 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023113084b019379bb84251a5eba2fa15ab2697 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023113084b019379bb84251a5eba2fa15ab2697 2023-11-30 20:55:47,723 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130ae449cce160e4974a4d4fa3eeaa0fbb0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130ae449cce160e4974a4d4fa3eeaa0fbb0 2023-11-30 20:55:47,743 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/eabb046ffb46449a863fb7db89b974f3 2023-11-30 20:55:48,137 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/2a191e7bcc4e4b00954a586547e0b88a 2023-11-30 20:55:48,137 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=228, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/1a73b936b86d41568ba0e4dcf4712163 2023-11-30 20:55:48,190 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023113027ec002380414ef39aed2bdd051db077 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023113027ec002380414ef39aed2bdd051db077 2023-11-30 20:55:48,588 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023113012e38d7c15dd44fa82fab4dc4615fcc3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023113012e38d7c15dd44fa82fab4dc4615fcc3 2023-11-30 20:55:48,588 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311304bdb74d5b61846bea4c8077373e3a0c2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311304bdb74d5b61846bea4c8077373e3a0c2 2023-11-30 20:55:48,592 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/b8b9b6d225254a5ab513554544a2d01c 2023-11-30 20:55:48,594 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/cd104b8052d8478892c26d5ca23745b5 2023-11-30 20:55:48,596 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/2a191e7bcc4e4b00954a586547e0b88a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/2a191e7bcc4e4b00954a586547e0b88a 2023-11-30 20:55:48,598 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/eabb046ffb46449a863fb7db89b974f3 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/eabb046ffb46449a863fb7db89b974f3 2023-11-30 20:55:48,620 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/2a191e7bcc4e4b00954a586547e0b88a, entries=4, sequenceid=5, filesize=5.5 K 2023-11-30 20:55:48,620 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/eabb046ffb46449a863fb7db89b974f3, entries=4, sequenceid=5, filesize=5.5 K 2023-11-30 20:55:48,621 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/b8b9b6d225254a5ab513554544a2d01c as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/b8b9b6d225254a5ab513554544a2d01c 2023-11-30 20:55:48,621 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/cd104b8052d8478892c26d5ca23745b5 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/cd104b8052d8478892c26d5ca23745b5 2023-11-30 20:55:48,624 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/cd104b8052d8478892c26d5ca23745b5, entries=2, sequenceid=5, filesize=5.1 K 2023-11-30 20:55:48,624 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/b8b9b6d225254a5ab513554544a2d01c, entries=2, sequenceid=5, filesize=5.1 K 2023-11-30 20:55:48,625 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 5c8e64d8810f3630e0dc789f524c2bd7 in 1353ms, sequenceid=5, compaction requested=false 2023-11-30 20:55:48,625 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for 3ba2330b8c4670c795e548e8c3f7ab18 in 1352ms, sequenceid=5, compaction requested=false 2023-11-30 20:55:48,626 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:55:48,626 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:55:48,626 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:48,626 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:48,626 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:48,626 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:48,993 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=5, memsize=114, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/9857f6bed1974e8fb22f280b8d4434d4 2023-11-30 20:55:48,997 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/1a73b936b86d41568ba0e4dcf4712163 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/1a73b936b86d41568ba0e4dcf4712163 2023-11-30 20:55:49,020 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/1a73b936b86d41568ba0e4dcf4712163, entries=4, sequenceid=5, filesize=5.5 K 2023-11-30 20:55:49,020 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/9857f6bed1974e8fb22f280b8d4434d4 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/9857f6bed1974e8fb22f280b8d4434d4 2023-11-30 20:55:49,023 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/9857f6bed1974e8fb22f280b8d4434d4, entries=2, sequenceid=5, filesize=5.1 K 2023-11-30 20:55:49,024 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~342 B/342, heapSize ~1.24 KB/1272, currentSize=0 B/0 for ac7a1c004e53268e4385b265a4168677 in 1752ms, sequenceid=5, compaction requested=false 2023-11-30 20:55:49,024 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:55:49,024 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:49,024 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:49,024 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:49,024 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,024 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-30 20:55:49,025 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-30 20:55:49,028 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,028 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:49,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:49,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:49,028 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:49,028 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:49,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:49,028 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:49,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:49,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,029 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:49,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-30 20:55:49,029 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@50141003[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:49,029 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-30 20:55:49,029 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:49,031 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:49,031 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:49,031 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:49,031 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-30 20:55:49,031 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-30 20:55:49,031 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:49,031 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,031 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:49,032 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-30 20:55:49,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:49,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:49,032 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-30 20:55:49,032 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:49,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:49,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:49,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,033 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:49,034 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-30 20:55:49,034 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-30 20:55:49,034 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:49,034 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:49,034 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-30 20:55:49,034 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:49,042 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:49,042 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:49,042 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:49,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:49,042 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:49,043 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:49,043 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:49,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:49,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:49,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:49,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,044 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:49,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:49,045 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:49,047 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:49,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:49,047 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-30 20:55:49,047 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:49,047 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:49,047 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:49,047 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:49,147 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:49,148 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:49,149 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:49,149 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:49,150 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:49,152 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:49,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:49,153 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-30 20:55:49,153 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-30 20:55:49,153 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:49,154 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-30 20:55:49,154 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-30 20:55:49,154 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:49,154 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:49,156 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,156 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:49,156 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:49,156 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:49,156 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:49,156 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:49,157 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:49,157 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:49,157 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-30 20:55:49,157 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-30 20:55:49,157 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-30 20:55:49,157 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-30 20:55:49,157 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:49,158 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-30 20:55:49,160 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:49,160 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. started... 2023-11-30 20:55:49,160 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:49,160 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. started... 2023-11-30 20:55:49,160 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5c8e64d8810f3630e0dc789f524c2bd7 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-30 20:55:49,160 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ac7a1c004e53268e4385b265a4168677 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-30 20:55:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:49,164 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:49,164 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:49,164 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. started... 2023-11-30 20:55:49,164 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3ba2330b8c4670c795e548e8c3f7ab18 2/2 column families, dataSize=462 B heapSize=1.39 KB 2023-11-30 20:55:49,215 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311304ecaf149b44e4aa5995a56ecff27038b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311304ecaf149b44e4aa5995a56ecff27038b 2023-11-30 20:55:49,215 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130dfb11cb194ad4a0399c51bcec4c3a67e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130dfb11cb194ad4a0399c51bcec4c3a67e 2023-11-30 20:55:49,613 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130462392c1b51744b2ade63298ceb05255 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231130462392c1b51744b2ade63298ceb05255 2023-11-30 20:55:49,629 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/a649baa7d20a4ae08c83ba15c65f5395 2023-11-30 20:55:49,630 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/6342448908874d63834cf25135104cc7 2023-11-30 20:55:50,028 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=308, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/cf0b4338459e4d3a9c7c410bb7531705 2023-11-30 20:55:50,073 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311305a786a5bf06e49a38a94d5d33258db2e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311305a786a5bf06e49a38a94d5d33258db2e 2023-11-30 20:55:50,073 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130205a43ffcc2e464fb22e9b354a372204 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231130205a43ffcc2e464fb22e9b354a372204 2023-11-30 20:55:50,466 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130d10144132b494c699815da40bfca7c25 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e20231130d10144132b494c699815da40bfca7c25 2023-11-30 20:55:50,478 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/252bb62cc8254ce7ae3050c8b83ae308 2023-11-30 20:55:50,478 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/2a7aea2f82d648819b026abf6ec544f5 2023-11-30 20:55:50,482 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/6342448908874d63834cf25135104cc7 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/6342448908874d63834cf25135104cc7 2023-11-30 20:55:50,482 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/a649baa7d20a4ae08c83ba15c65f5395 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/a649baa7d20a4ae08c83ba15c65f5395 2023-11-30 20:55:50,517 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/a649baa7d20a4ae08c83ba15c65f5395, entries=4, sequenceid=9, filesize=5.5 K 2023-11-30 20:55:50,517 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/6342448908874d63834cf25135104cc7, entries=4, sequenceid=9, filesize=5.5 K 2023-11-30 20:55:50,518 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/2a7aea2f82d648819b026abf6ec544f5 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/2a7aea2f82d648819b026abf6ec544f5 2023-11-30 20:55:50,519 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/252bb62cc8254ce7ae3050c8b83ae308 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/252bb62cc8254ce7ae3050c8b83ae308 2023-11-30 20:55:50,523 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/252bb62cc8254ce7ae3050c8b83ae308, entries=2, sequenceid=9, filesize=5.1 K 2023-11-30 20:55:50,523 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/2a7aea2f82d648819b026abf6ec544f5, entries=2, sequenceid=9, filesize=5.1 K 2023-11-30 20:55:50,523 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 3ba2330b8c4670c795e548e8c3f7ab18 in 1359ms, sequenceid=9, compaction requested=false 2023-11-30 20:55:50,524 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:55:50,524 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:50,524 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:50,524 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for ac7a1c004e53268e4385b265a4168677 in 1364ms, sequenceid=9, compaction requested=false 2023-11-30 20:55:50,524 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:55:50,524 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:50,524 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:50,872 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=9, memsize=154, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/68cb4728b17e42199a3db09aef5fcd5e 2023-11-30 20:55:50,876 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/cf0b4338459e4d3a9c7c410bb7531705 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/cf0b4338459e4d3a9c7c410bb7531705 2023-11-30 20:55:50,904 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/cf0b4338459e4d3a9c7c410bb7531705, entries=4, sequenceid=9, filesize=5.5 K 2023-11-30 20:55:50,905 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/68cb4728b17e42199a3db09aef5fcd5e as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/68cb4728b17e42199a3db09aef5fcd5e 2023-11-30 20:55:50,909 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/68cb4728b17e42199a3db09aef5fcd5e, entries=2, sequenceid=9, filesize=5.1 K 2023-11-30 20:55:50,909 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~462 B/462, heapSize ~1.36 KB/1392, currentSize=0 B/0 for 5c8e64d8810f3630e0dc789f524c2bd7 in 1749ms, sequenceid=9, compaction requested=false 2023-11-30 20:55:50,910 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:55:50,910 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:50,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:50,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:50,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-30 20:55:50,910 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-30 20:55:50,911 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,911 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:50,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:50,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:50,912 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:50,912 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:50,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:50,912 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:50,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:50,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,913 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:50,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-30 20:55:50,913 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7c744dc7[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:50,913 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-30 20:55:50,913 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:50,916 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:50,916 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:50,916 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:50,917 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-30 20:55:50,917 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-30 20:55:50,917 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:50,917 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,917 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:50,918 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-30 20:55:50,918 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,918 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:50,918 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-30 20:55:50,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:50,918 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:50,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:50,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:50,919 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:50,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:50,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:50,920 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,921 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:50,921 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-30 20:55:50,921 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-30 20:55:50,921 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:50,921 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:50,921 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-30 20:55:50,921 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:50,927 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:50,927 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:50,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:50,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:50,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:50,927 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:50,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:50,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:50,927 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:50,927 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:50,927 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:50,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:50,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:50,928 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:50,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:50,929 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:50,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:50,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:50,931 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:50,931 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-30 20:55:50,931 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:50,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:50,931 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:50,931 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:50,931 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:50,932 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:50,932 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:51,031 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:51,032 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:51,033 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:51,034 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:51,034 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:51,036 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:51,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:51,037 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-30 20:55:51,037 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-30 20:55:51,038 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:51,038 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-30 20:55:51,038 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-30 20:55:51,038 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:51,038 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:51,040 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:51,040 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:51,040 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:51,041 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:51,041 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:51,041 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:51,042 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:51,043 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:51,043 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:51,044 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:51,044 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-30 20:55:51,044 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-30 20:55:51,044 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-30 20:55:51,044 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-30 20:55:51,044 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:51,044 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-30 20:55:51,045 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:51,045 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. started... 2023-11-30 20:55:51,045 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5c8e64d8810f3630e0dc789f524c2bd7 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-30 20:55:51,045 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:51,045 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. started... 2023-11-30 20:55:51,045 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ac7a1c004e53268e4385b265a4168677 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-30 20:55:51,048 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:51,048 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:51,048 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:51,048 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. started... 2023-11-30 20:55:51,049 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3ba2330b8c4670c795e548e8c3f7ab18 2/2 column families, dataSize=582 B heapSize=1.51 KB 2023-11-30 20:55:51,112 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023113060d3b2f766e045d081e667be52c18cdb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023113060d3b2f766e045d081e667be52c18cdb 2023-11-30 20:55:51,127 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/0ff5a576addd48beb1315dffd98f9314 2023-11-30 20:55:51,159 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311308b514558d5a34663bb7ca078503d83c1 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311308b514558d5a34663bb7ca078503d83c1 2023-11-30 20:55:51,335 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:55:51,335 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x50381709 to 127.0.0.1:58095 2023-11-30 20:55:51,335 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:55:51,336 INFO [Finalizer] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:55:51,336 DEBUG [Finalizer] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x1fc74ae2 to 127.0.0.1:58095 2023-11-30 20:55:51,336 DEBUG [Finalizer] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:55:51,499 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130cfa0c90752bc4e41921f20a7ffd19f31 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130cfa0c90752bc4e41921f20a7ffd19f31 2023-11-30 20:55:51,500 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130b9c9fecc49ae400c929d9a3800b02c75 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130b9c9fecc49ae400c929d9a3800b02c75 2023-11-30 20:55:51,564 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/7aa60dc217d648d280b56f3e49007d41 2023-11-30 20:55:51,570 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/0ff5a576addd48beb1315dffd98f9314 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/0ff5a576addd48beb1315dffd98f9314 2023-11-30 20:55:51,600 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/0ff5a576addd48beb1315dffd98f9314, entries=4, sequenceid=13, filesize=5.5 K 2023-11-30 20:55:51,601 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/7aa60dc217d648d280b56f3e49007d41 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/7aa60dc217d648d280b56f3e49007d41 2023-11-30 20:55:51,605 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/7aa60dc217d648d280b56f3e49007d41, entries=2, sequenceid=13, filesize=5.1 K 2023-11-30 20:55:51,606 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 5c8e64d8810f3630e0dc789f524c2bd7 in 561ms, sequenceid=13, compaction requested=true 2023-11-30 20:55:51,606 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:55:51,606 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:51,606 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:51,858 WARN [HBase-Metrics2-1] impl.MetricsConfig(128): Cannot locate configuration: tried hadoop-metrics2-hbase.properties,hadoop-metrics2.properties 2023-11-30 20:55:51,921 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/bb3f48f3217946309de9dcb4b2a0bfc2 2023-11-30 20:55:51,921 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=388, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/21a206d30d324469827412a69210ebb4 2023-11-30 20:55:51,965 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c2023113041e0966f5d8b43759e60444166263346 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c2023113041e0966f5d8b43759e60444166263346 2023-11-30 20:55:51,976 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/404569e6fe0343d39558da9a3954a79f 2023-11-30 20:55:51,983 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/21a206d30d324469827412a69210ebb4 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/21a206d30d324469827412a69210ebb4 2023-11-30 20:55:52,009 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/21a206d30d324469827412a69210ebb4, entries=4, sequenceid=13, filesize=5.5 K 2023-11-30 20:55:52,010 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/404569e6fe0343d39558da9a3954a79f as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/404569e6fe0343d39558da9a3954a79f 2023-11-30 20:55:52,014 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/404569e6fe0343d39558da9a3954a79f, entries=2, sequenceid=13, filesize=5.1 K 2023-11-30 20:55:52,014 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for ac7a1c004e53268e4385b265a4168677 in 969ms, sequenceid=13, compaction requested=true 2023-11-30 20:55:52,014 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:55:52,015 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:52,015 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:52,366 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130f1af2164c6ad4c33abe708b3d772134a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b20231130f1af2164c6ad4c33abe708b3d772134a 2023-11-30 20:55:52,771 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=13, memsize=194, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/58f55743c3b64ce0b8ae49af79b5140d 2023-11-30 20:55:52,775 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/bb3f48f3217946309de9dcb4b2a0bfc2 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/bb3f48f3217946309de9dcb4b2a0bfc2 2023-11-30 20:55:52,798 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/bb3f48f3217946309de9dcb4b2a0bfc2, entries=4, sequenceid=13, filesize=5.5 K 2023-11-30 20:55:52,799 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/58f55743c3b64ce0b8ae49af79b5140d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/58f55743c3b64ce0b8ae49af79b5140d 2023-11-30 20:55:52,802 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/58f55743c3b64ce0b8ae49af79b5140d, entries=2, sequenceid=13, filesize=5.1 K 2023-11-30 20:55:52,803 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~582 B/582, heapSize ~1.48 KB/1512, currentSize=0 B/0 for 3ba2330b8c4670c795e548e8c3f7ab18 in 1755ms, sequenceid=13, compaction requested=true 2023-11-30 20:55:52,803 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:55:52,803 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-30 20:55:52,803 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-30 20:55:52,805 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:52,805 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:52,805 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:52,805 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:52,805 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:52,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:52,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:52,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,806 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:52,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-30 20:55:52,806 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@7793698e[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:52,806 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-30 20:55:52,807 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:52,808 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:52,808 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:52,808 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:52,808 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-30 20:55:52,808 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,808 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:52,808 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-30 20:55:52,808 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:52,810 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-30 20:55:52,810 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:52,810 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,810 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-30 20:55:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:52,810 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:52,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:52,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:52,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:52,811 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:52,812 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,813 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:52,813 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-30 20:55:52,813 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-30 20:55:52,813 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:52,813 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:52,813 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-30 20:55:52,813 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:52,815 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:52,815 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:52,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:52,815 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:52,815 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:52,815 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:52,816 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:52,816 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:52,817 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,817 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:52,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:52,818 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,819 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:52,819 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,819 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:52,820 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:52,819 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:52,820 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin because node does not exist (not an error) 2023-11-30 20:55:52,820 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-30 20:55:52,820 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:52,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:52,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:52,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:52,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:52,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:52,820 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:52,820 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:52,820 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:52,820 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:52,820 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:52,920 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:52,921 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:52,922 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:52,922 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:52,922 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(8805): writing data to region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. with WAL disabled. Data may be lost in the event of a crash. 2023-11-30 20:55:52,924 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:52,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:52,926 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-30 20:55:52,926 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-30 20:55:52,926 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:52,926 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-30 20:55:52,926 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-30 20:55:52,927 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:52,927 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:52,929 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,929 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:52,929 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:52,929 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:52,930 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:52,930 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:52,930 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:52,930 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:52,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:52,931 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:52,931 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-30 20:55:52,931 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-30 20:55:52,931 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-30 20:55:52,931 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-30 20:55:52,931 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:52,931 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-30 20:55:52,932 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:52,932 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. started... 2023-11-30 20:55:52,932 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:52,932 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5c8e64d8810f3630e0dc789f524c2bd7 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-30 20:55:52,932 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:52,932 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. started... 2023-11-30 20:55:52,932 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:52,932 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:52,932 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ac7a1c004e53268e4385b265a4168677 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-30 20:55:52,932 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. started... 2023-11-30 20:55:52,932 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3ba2330b8c4670c795e548e8c3f7ab18 2/2 column families, dataSize=702 B heapSize=1.63 KB 2023-11-30 20:55:53,016 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023113009c361b90ca4486a85426393384c1cf5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023113009c361b90ca4486a85426393384c1cf5 2023-11-30 20:55:53,020 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311300ac00ce1174446858b670de9653c4e27 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311300ac00ce1174446858b670de9653c4e27 2023-11-30 20:55:53,040 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/287d211e577d480486afbbce5daa60e6 2023-11-30 20:55:53,093 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c202311300360a2ebac4b4303a3093f7cb23c8b9d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c202311300360a2ebac4b4303a3093f7cb23c8b9d 2023-11-30 20:55:53,406 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023113039732cfe818b454e9cb9aa6c1b76a2f0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023113039732cfe818b454e9cb9aa6c1b76a2f0 2023-11-30 20:55:53,438 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/677c4a6c810e4227b19dced6d48446ac 2023-11-30 20:55:53,502 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/c7b4ebfc46da4d9b8b956f8f9a7341f9 2023-11-30 20:55:53,506 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/287d211e577d480486afbbce5daa60e6 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/287d211e577d480486afbbce5daa60e6 2023-11-30 20:55:53,532 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/287d211e577d480486afbbce5daa60e6, entries=4, sequenceid=17, filesize=5.5 K 2023-11-30 20:55:53,533 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/c7b4ebfc46da4d9b8b956f8f9a7341f9 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/c7b4ebfc46da4d9b8b956f8f9a7341f9 2023-11-30 20:55:53,536 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/c7b4ebfc46da4d9b8b956f8f9a7341f9, entries=2, sequenceid=17, filesize=5.1 K 2023-11-30 20:55:53,537 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for ac7a1c004e53268e4385b265a4168677 in 605ms, sequenceid=17, compaction requested=true 2023-11-30 20:55:53,537 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:55:53,537 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:53,537 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:53,820 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=468, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/f202924f6eec424eb4a44824f05e3b1a 2023-11-30 20:55:53,853 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311305e92403e9f64469aac241e9a3457f083 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b202311305e92403e9f64469aac241e9a3457f083 2023-11-30 20:55:53,867 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e2023113038f2490d8110429d8b28f3b470ec23cb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e2023113038f2490d8110429d8b28f3b470ec23cb 2023-11-30 20:55:54,257 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/a91a1882f8c34878b83663d8ccff9d24 2023-11-30 20:55:54,261 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/f202924f6eec424eb4a44824f05e3b1a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/f202924f6eec424eb4a44824f05e3b1a 2023-11-30 20:55:54,273 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=17, memsize=234, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/651e11746208420da26420509d371b78 2023-11-30 20:55:54,276 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/677c4a6c810e4227b19dced6d48446ac as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/677c4a6c810e4227b19dced6d48446ac 2023-11-30 20:55:54,292 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/f202924f6eec424eb4a44824f05e3b1a, entries=4, sequenceid=17, filesize=5.5 K 2023-11-30 20:55:54,293 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/a91a1882f8c34878b83663d8ccff9d24 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/a91a1882f8c34878b83663d8ccff9d24 2023-11-30 20:55:54,296 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/a91a1882f8c34878b83663d8ccff9d24, entries=2, sequenceid=17, filesize=5.1 K 2023-11-30 20:55:54,297 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 3ba2330b8c4670c795e548e8c3f7ab18 in 1365ms, sequenceid=17, compaction requested=true 2023-11-30 20:55:54,297 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:55:54,297 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:54,297 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:54,311 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/677c4a6c810e4227b19dced6d48446ac, entries=4, sequenceid=17, filesize=5.5 K 2023-11-30 20:55:54,312 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/651e11746208420da26420509d371b78 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/651e11746208420da26420509d371b78 2023-11-30 20:55:54,315 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/651e11746208420da26420509d371b78, entries=2, sequenceid=17, filesize=5.1 K 2023-11-30 20:55:54,316 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~702 B/702, heapSize ~1.59 KB/1632, currentSize=0 B/0 for 5c8e64d8810f3630e0dc789f524c2bd7 in 1384ms, sequenceid=17, compaction requested=true 2023-11-30 20:55:54,316 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:55:54,316 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:54,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:54,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:54,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-30 20:55:54,316 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-30 20:55:54,318 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:54,318 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:54,318 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:54,319 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:54,319 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,320 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:54,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-30 20:55:54,320 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@75ce5030[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:54,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-30 20:55:54,320 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:54,324 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:54,324 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:54,324 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:54,324 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-30 20:55:54,325 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-30 20:55:54,325 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:54,325 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,325 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:54,327 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,327 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-30 20:55:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:54,327 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:54,327 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:54,327 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-30 20:55:54,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:54,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:54,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:54,328 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:54,329 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,330 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:54,330 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-30 20:55:54,330 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-30 20:55:54,330 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:54,330 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:54,330 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-30 20:55:54,330 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:54,331 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:54,331 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:54,331 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:54,331 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:54,331 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:54,332 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:54,332 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:54,332 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,333 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,333 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:54,334 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,335 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,335 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:54,335 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:54,335 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:54,335 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,336 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:54,336 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:54,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-30 20:55:54,336 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:54,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:54,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:54,336 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:54,336 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:54,336 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:54,336 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:54,336 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:54,336 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:54,336 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:54,436 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:54,437 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:54,446 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:54,455 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:54,464 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:55:54,465 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:55:54,546 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(936): Client=jenkins//172.31.14.131 procedure request for: flush-table-proc 2023-11-30 20:55:54,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(143): Procedure testMajorCompactionFromAdmin was in running list but was completed. Accepting new attempt. 2023-11-30 20:55:54,547 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] procedure.ProcedureCoordinator(165): Submitting procedure testMajorCompactionFromAdmin 2023-11-30 20:55:54,548 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(191): Starting procedure 'testMajorCompactionFromAdmin' 2023-11-30 20:55:54,548 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:54,548 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(199): Procedure 'testMajorCompactionFromAdmin' starting 'acquire' 2023-11-30 20:55:54,548 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(241): Starting procedure 'testMajorCompactionFromAdmin', kicking off acquire phase on members. 2023-11-30 20:55:54,548 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:54,548 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(92): Creating acquire znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:54,549 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:54,549 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(100): Watching for acquire node:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,550 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:54,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:54,550 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:54,550 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(203): Waiting for all members to 'acquire' 2023-11-30 20:55:54,550 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(186): Found procedure znode: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:54,550 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:54,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(212): start proc data length is 4 2023-11-30 20:55:54,551 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(214): Found data for znode:/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:54,551 DEBUG [zk-event-processor-pool-0] flush.RegionServerFlushTableProcedureManager(153): Launching subprocedure to flush regions for testMajorCompactionFromAdmin 2023-11-30 20:55:54,551 WARN [zk-event-processor-pool-0] procedure.ProcedureMember(133): A completed old subproc testMajorCompactionFromAdmin is still present, removing 2023-11-30 20:55:54,551 DEBUG [zk-event-processor-pool-0] procedure.ProcedureMember(140): Submitting new Subprocedure:testMajorCompactionFromAdmin 2023-11-30 20:55:54,551 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(151): Starting subprocedure 'testMajorCompactionFromAdmin' with timeout 60000ms 2023-11-30 20:55:54,551 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(107): Scheduling process timer to run in: 60000 ms 2023-11-30 20:55:54,551 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(159): Subprocedure 'testMajorCompactionFromAdmin' starting 'acquire' stage 2023-11-30 20:55:54,551 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:54,551 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. started... 2023-11-30 20:55:54,551 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:54,551 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2745): Flushing 5c8e64d8810f3630e0dc789f524c2bd7 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-30 20:55:54,551 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. started... 2023-11-30 20:55:54,551 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.FlushTableSubprocedure(113): Flush region tasks submitted for 3 regions 2023-11-30 20:55:54,551 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(242): Waiting for local region flush to finish. 2023-11-30 20:55:54,551 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(69): Starting region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:54,551 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2745): Flushing ac7a1c004e53268e4385b265a4168677 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-30 20:55:54,552 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(72): Flush region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. started... 2023-11-30 20:55:54,552 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2745): Flushing 3ba2330b8c4670c795e548e8c3f7ab18 2/2 column families, dataSize=138 B heapSize=944 B 2023-11-30 20:55:54,985 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/87863b2770ce42ac86ae9b72058ac86d 2023-11-30 20:55:54,988 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/820bf5dfad9548cdb805b4aa60698cfb 2023-11-30 20:55:55,009 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87863b2770ce42ac86ae9b72058ac86d 2023-11-30 20:55:55,013 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 820bf5dfad9548cdb805b4aa60698cfb 2023-11-30 20:55:55,023 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/86e7063b4c6d4e64a75efda81fb32c09 2023-11-30 20:55:55,026 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86e7063b4c6d4e64a75efda81fb32c09 2023-11-30 20:55:55,026 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/820bf5dfad9548cdb805b4aa60698cfb as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/820bf5dfad9548cdb805b4aa60698cfb 2023-11-30 20:55:55,049 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 820bf5dfad9548cdb805b4aa60698cfb 2023-11-30 20:55:55,050 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/820bf5dfad9548cdb805b4aa60698cfb, entries=3, sequenceid=23, filesize=5.2 K 2023-11-30 20:55:55,050 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/86e7063b4c6d4e64a75efda81fb32c09 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/86e7063b4c6d4e64a75efda81fb32c09 2023-11-30 20:55:55,053 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 86e7063b4c6d4e64a75efda81fb32c09 2023-11-30 20:55:55,053 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/86e7063b4c6d4e64a75efda81fb32c09, entries=1, sequenceid=23, filesize=5.0 K 2023-11-30 20:55:55,054 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for ac7a1c004e53268e4385b265a4168677 in 503ms, sequenceid=23, compaction requested=true 2023-11-30 20:55:55,054 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] regionserver.HRegion(2446): Flush status journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:55:55,054 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-1] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:55,054 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 1/3 local region flush tasks. 2023-11-30 20:55:55,384 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=106, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/8462e07ccc444cd8be1d344836817bdd 2023-11-30 20:55:55,407 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8462e07ccc444cd8be1d344836817bdd 2023-11-30 20:55:55,820 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/24d423930d49469fae4f632cb7a60d3c 2023-11-30 20:55:55,824 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24d423930d49469fae4f632cb7a60d3c 2023-11-30 20:55:55,825 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/87863b2770ce42ac86ae9b72058ac86d as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/87863b2770ce42ac86ae9b72058ac86d 2023-11-30 20:55:55,859 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 87863b2770ce42ac86ae9b72058ac86d 2023-11-30 20:55:55,860 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/87863b2770ce42ac86ae9b72058ac86d, entries=3, sequenceid=23, filesize=5.2 K 2023-11-30 20:55:55,860 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/24d423930d49469fae4f632cb7a60d3c as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/24d423930d49469fae4f632cb7a60d3c 2023-11-30 20:55:55,864 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 24d423930d49469fae4f632cb7a60d3c 2023-11-30 20:55:55,864 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/24d423930d49469fae4f632cb7a60d3c, entries=1, sequenceid=23, filesize=5.0 K 2023-11-30 20:55:55,865 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 5c8e64d8810f3630e0dc789f524c2bd7 in 1314ms, sequenceid=23, compaction requested=true 2023-11-30 20:55:55,865 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] regionserver.HRegion(2446): Flush status journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:55:55,865 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-0] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:55,865 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 2/3 local region flush tasks. 2023-11-30 20:55:56,219 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] mob.DefaultMobStoreFlusher(134): Mob store is flushed, sequenceid=23, memsize=32, hasBloomFilter=true, into tmp file hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/053a2e556b32430f9d4aec3d96500170 2023-11-30 20:55:56,223 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 053a2e556b32430f9d4aec3d96500170 2023-11-30 20:55:56,223 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/8462e07ccc444cd8be1d344836817bdd as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/8462e07ccc444cd8be1d344836817bdd 2023-11-30 20:55:56,246 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 8462e07ccc444cd8be1d344836817bdd 2023-11-30 20:55:56,246 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/8462e07ccc444cd8be1d344836817bdd, entries=3, sequenceid=23, filesize=5.2 K 2023-11-30 20:55:56,247 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/053a2e556b32430f9d4aec3d96500170 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/053a2e556b32430f9d4aec3d96500170 2023-11-30 20:55:56,251 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 053a2e556b32430f9d4aec3d96500170 2023-11-30 20:55:56,251 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/053a2e556b32430f9d4aec3d96500170, entries=1, sequenceid=23, filesize=5.0 K 2023-11-30 20:55:56,251 INFO [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2948): Finished flush of dataSize ~138 B/138, heapSize ~912 B/912, currentSize=0 B/0 for 3ba2330b8c4670c795e548e8c3f7ab18 in 1699ms, sequenceid=23, compaction requested=true 2023-11-30 20:55:56,251 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] regionserver.HRegion(2446): Flush status journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:55:56,252 DEBUG [rs(jenkins-hbase4.apache.org,40365,1701377600631)-flush-proc-pool-2] flush.FlushTableSubprocedure$RegionFlushTask(80): Closing region operation on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:56,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(253): Completed 3/3 local region flush tasks. 2023-11-30 20:55:56,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(255): Completed 3 local region flush tasks. 2023-11-30 20:55:56,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] flush.RegionServerFlushTableProcedureManager$FlushTableSubprocedurePool(287): cancelling 0 flush region tasks jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(161): Subprocedure 'testMajorCompactionFromAdmin' locally acquired 2023-11-30 20:55:56,252 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(242): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure (testMajorCompactionFromAdmin) in zk 2023-11-30 20:55:56,254 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(250): Watch for global barrier reached:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:56,254 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:56,254 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:56,254 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(166): Subprocedure 'testMajorCompactionFromAdmin' coordinator notified of 'acquire', waiting on 'reached' or 'abort' from coordinator 2023-11-30 20:55:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:56,254 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(291): member: 'jenkins-hbase4.apache.org,40365,1701377600631' joining acquired barrier for procedure 'testMajorCompactionFromAdmin' on coordinator 2023-11-30 20:55:56,255 DEBUG [zk-event-processor-pool-0] procedure.Procedure(300): Waiting on: java.util.concurrent.CountDownLatch@5aac282[Count = 0] remaining members to acquire global barrier 2023-11-30 20:55:56,255 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(207): Procedure 'testMajorCompactionFromAdmin' starting 'in-barrier' execution. 2023-11-30 20:55:56,255 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(116): Creating reached barrier zk node:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:56,257 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:56,257 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:56,257 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(128): Received reached global barrier:/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:56,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(180): Subprocedure 'testMajorCompactionFromAdmin' received 'reached' from coordinator. 2023-11-30 20:55:56,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(182): Subprocedure 'testMajorCompactionFromAdmin' locally completed 2023-11-30 20:55:56,258 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.ZKProcedureMemberRpcs(267): Marking procedure 'testMajorCompactionFromAdmin' completed for member 'jenkins-hbase4.apache.org,40365,1701377600631' in zk 2023-11-30 20:55:56,258 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,258 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(211): Waiting for all members to 'release' 2023-11-30 20:55:56,259 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(187): Subprocedure 'testMajorCompactionFromAdmin' has notified controller of completion 2023-11-30 20:55:56,259 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:56,259 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,259 DEBUG [member: 'jenkins-hbase4.apache.org,40365,1701377600631' subprocedure-pool-0] procedure.Subprocedure(212): Subprocedure 'testMajorCompactionFromAdmin' completed. 2023-11-30 20:55:56,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:56,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:56,259 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:56,260 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:56,261 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,262 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(218): Finished data from procedure 'testMajorCompactionFromAdmin' member 'jenkins-hbase4.apache.org,40365,1701377600631': 2023-11-30 20:55:56,262 DEBUG [zk-event-processor-pool-0] procedure.Procedure(321): Member: 'jenkins-hbase4.apache.org,40365,1701377600631' released barrier for procedure'testMajorCompactionFromAdmin', counting down latch. Waiting for 0 more 2023-11-30 20:55:56,262 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(216): Procedure 'testMajorCompactionFromAdmin' execution completed 2023-11-30 20:55:56,262 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(225): Running finish phase. 2023-11-30 20:55:56,262 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.Procedure(275): Finished coordinator procedure - removing self from list of running procedures 2023-11-30 20:55:56,262 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureCoordinator(162): Attempting to clean out zk node for op:testMajorCompactionFromAdmin 2023-11-30 20:55:56,262 INFO [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] procedure.ZKProcedureUtil(265): Clearing all znodes for procedure testMajorCompactionFromAdminincluding nodes /hbase/flush-table-proc/acquired /hbase/flush-table-proc/reached /hbase/flush-table-proc/abort 2023-11-30 20:55:56,263 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:56,263 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:56,263 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(77): Received created event:/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:56,263 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeCreated, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureCoordinator$1(194): Node created: /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(225): Current zk system: 2023-11-30 20:55:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(227): |-/hbase/flush-table-proc 2023-11-30 20:55:56,264 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-abort 2023-11-30 20:55:56,264 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(316): Aborting procedure member for znode /hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:56,264 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-acquired 2023-11-30 20:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:56,265 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,265 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] zookeeper.ZKUtil(163): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on existing znode=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-reached 2023-11-30 20:55:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |----testMajorCompactionFromAdmin 2023-11-30 20:55:56,266 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureUtil(244): |-------jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:56,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(104): Received procedure start children changed event: /hbase/flush-table-proc/acquired 2023-11-30 20:55:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(154): Looking for new procedures under znode:'/hbase/flush-table-proc/acquired' 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/abort 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/acquired/testMajorCompactionFromAdmin 2023-11-30 20:55:56,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(180): Done waiting - exec procedure flush-table-proc for 'testMajorCompactionFromAdmin' 2023-11-30 20:55:56,269 INFO [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] flush.MasterFlushTableProcedureManager(182): Master flush table procedure is successful! 2023-11-30 20:55:56,269 DEBUG [(jenkins-hbase4.apache.org,43087,1701377599413)-proc-coordinator-pool-0] errorhandling.TimeoutExceptionInjector(87): Marking timer as complete - no error notifications will be received for this timer. 2023-11-30 20:55:56,269 INFO [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs$1(107): Received procedure abort children changed event: /hbase/flush-table-proc/abort 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:55:56,269 DEBUG [zk-event-processor-pool-0] procedure.ZKProcedureMemberRpcs(134): Checking for aborted procedures on node: '/hbase/flush-table-proc/abort' 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/reached/testMajorCompactionFromAdmin 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/flush-table-proc/abort/testMajorCompactionFromAdmin 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2690): Waiting a max of 300000 ms for procedure 'flush-table-proc : testMajorCompactionFromAdmin'' to complete. (max 300000 ms per retry) 2023-11-30 20:55:56,269 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2698): (#1) Sleeping: 100ms while waiting for procedure completion. 2023-11-30 20:55:56,370 DEBUG [Listener at localhost/34291] client.HBaseAdmin(2704): Getting current status of procedure from master... 2023-11-30 20:55:56,370 DEBUG [RpcServer.default.FPBQ.Fifo.handler=1,queue=0,port=43087] master.MasterRpcServices(1189): Checking to see if procedure from request:flush-table-proc is done 2023-11-30 20:55:56,371 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:56,371 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 5c8e64d8810f3630e0dc789f524c2bd7/family1 is initiating major compaction (all files) 2023-11-30 20:55:56,371 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:56,371 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:56,373 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 5c8e64d8810f3630e0dc789f524c2bd7/family1 in testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:56,373 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/eabb046ffb46449a863fb7db89b974f3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/cf0b4338459e4d3a9c7c410bb7531705, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/0ff5a576addd48beb1315dffd98f9314, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/677c4a6c810e4227b19dced6d48446ac, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/87863b2770ce42ac86ae9b72058ac86d] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp, totalSize=27.1 K 2023-11-30 20:55:56,373 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting eabb046ffb46449a863fb7db89b974f3, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377747262 2023-11-30 20:55:56,374 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting cf0b4338459e4d3a9c7c410bb7531705, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377749149 2023-11-30 20:55:56,374 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 0ff5a576addd48beb1315dffd98f9314, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377751033 2023-11-30 20:55:56,374 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 677c4a6c810e4227b19dced6d48446ac, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377752922 2023-11-30 20:55:56,375 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 87863b2770ce42ac86ae9b72058ac86d, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:56,385 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 5c8e64d8810f3630e0dc789f524c2bd7#family1#compaction#198 average throughput is 0.34 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:56,825 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231130f33149c51c1e4302977feb19c9d713d7_del 2023-11-30 20:55:56,825 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130f33149c51c1e4302977feb19c9d713d7_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231130f33149c51c1e4302977feb19c9d713d7_del 2023-11-30 20:55:57,299 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c0d891954a0412d8e3908db9fc4f095 2023-11-30 20:55:57,300 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family1/0c0d891954a0412d8e3908db9fc4f095 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/0c0d891954a0412d8e3908db9fc4f095 2023-11-30 20:55:57,327 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 0c0d891954a0412d8e3908db9fc4f095 2023-11-30 20:55:57,328 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5c8e64d8810f3630e0dc789f524c2bd7/family1 of 5c8e64d8810f3630e0dc789f524c2bd7 into 0c0d891954a0412d8e3908db9fc4f095(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:57,329 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:55:57,329 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:57,329 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 5c8e64d8810f3630e0dc789f524c2bd7/family2 is initiating major compaction (all files) 2023-11-30 20:55:57,329 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:57,329 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:57,330 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 5c8e64d8810f3630e0dc789f524c2bd7/family2 in testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:55:57,330 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/cd104b8052d8478892c26d5ca23745b5, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/68cb4728b17e42199a3db09aef5fcd5e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/7aa60dc217d648d280b56f3e49007d41, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/651e11746208420da26420509d371b78, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/24d423930d49469fae4f632cb7a60d3c] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp, totalSize=25.4 K 2023-11-30 20:55:57,331 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting cd104b8052d8478892c26d5ca23745b5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377747262 2023-11-30 20:55:57,331 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 68cb4728b17e42199a3db09aef5fcd5e, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377749149 2023-11-30 20:55:57,332 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 7aa60dc217d648d280b56f3e49007d41, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377751033 2023-11-30 20:55:57,332 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 651e11746208420da26420509d371b78, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377752922 2023-11-30 20:55:57,333 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 24d423930d49469fae4f632cb7a60d3c, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:57,349 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 5c8e64d8810f3630e0dc789f524c2bd7#family2#compaction#199 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:57,363 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e202311307a0241582cd6477cb1098f7f77ef964d_del 2023-11-30 20:55:57,363 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e202311307a0241582cd6477cb1098f7f77ef964d_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/d41d8cd98f00b204e9800998ecf8427e202311307a0241582cd6477cb1098f7f77ef964d_del 2023-11-30 20:55:57,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/eabb046ffb46449a863fb7db89b974f3, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/cf0b4338459e4d3a9c7c410bb7531705, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/0ff5a576addd48beb1315dffd98f9314, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/677c4a6c810e4227b19dced6d48446ac, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/87863b2770ce42ac86ae9b72058ac86d] to archive 2023-11-30 20:55:57,403 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:57,405 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/eabb046ffb46449a863fb7db89b974f3 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/eabb046ffb46449a863fb7db89b974f3 2023-11-30 20:55:57,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/cf0b4338459e4d3a9c7c410bb7531705 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/cf0b4338459e4d3a9c7c410bb7531705 2023-11-30 20:55:57,407 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/0ff5a576addd48beb1315dffd98f9314 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/0ff5a576addd48beb1315dffd98f9314 2023-11-30 20:55:57,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/677c4a6c810e4227b19dced6d48446ac to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/677c4a6c810e4227b19dced6d48446ac 2023-11-30 20:55:57,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/87863b2770ce42ac86ae9b72058ac86d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/87863b2770ce42ac86ae9b72058ac86d 2023-11-30 20:55:57,776 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9defc6575d0f47ab9e9a2ab134f5c149 2023-11-30 20:55:57,776 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/.tmp/family2/9defc6575d0f47ab9e9a2ab134f5c149 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/9defc6575d0f47ab9e9a2ab134f5c149 2023-11-30 20:55:57,780 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 9defc6575d0f47ab9e9a2ab134f5c149 2023-11-30 20:55:57,781 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 5c8e64d8810f3630e0dc789f524c2bd7/family2 of 5c8e64d8810f3630e0dc789f524c2bd7 into 9defc6575d0f47ab9e9a2ab134f5c149(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:57,781 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:55:57,781 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:57,781 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): ac7a1c004e53268e4385b265a4168677/family1 is initiating major compaction (all files) 2023-11-30 20:55:57,781 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:57,781 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:57,781 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of ac7a1c004e53268e4385b265a4168677/family1 in testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:57,782 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/1a73b936b86d41568ba0e4dcf4712163, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/a649baa7d20a4ae08c83ba15c65f5395, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/21a206d30d324469827412a69210ebb4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/287d211e577d480486afbbce5daa60e6, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/820bf5dfad9548cdb805b4aa60698cfb] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp, totalSize=27.1 K 2023-11-30 20:55:57,782 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 1a73b936b86d41568ba0e4dcf4712163, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377747263 2023-11-30 20:55:57,782 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting a649baa7d20a4ae08c83ba15c65f5395, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377749150 2023-11-30 20:55:57,782 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 21a206d30d324469827412a69210ebb4, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377751034 2023-11-30 20:55:57,783 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 287d211e577d480486afbbce5daa60e6, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377752922 2023-11-30 20:55:57,783 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 820bf5dfad9548cdb805b4aa60698cfb, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:57,790 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): ac7a1c004e53268e4385b265a4168677#family1#compaction#200 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:57,802 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/cd104b8052d8478892c26d5ca23745b5, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/68cb4728b17e42199a3db09aef5fcd5e, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/7aa60dc217d648d280b56f3e49007d41, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/651e11746208420da26420509d371b78, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/24d423930d49469fae4f632cb7a60d3c] to archive 2023-11-30 20:55:57,803 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:57,805 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/cd104b8052d8478892c26d5ca23745b5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/cd104b8052d8478892c26d5ca23745b5 2023-11-30 20:55:57,807 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/68cb4728b17e42199a3db09aef5fcd5e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/68cb4728b17e42199a3db09aef5fcd5e 2023-11-30 20:55:57,808 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/7aa60dc217d648d280b56f3e49007d41 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/7aa60dc217d648d280b56f3e49007d41 2023-11-30 20:55:57,810 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/651e11746208420da26420509d371b78 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/651e11746208420da26420509d371b78 2023-11-30 20:55:57,811 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/24d423930d49469fae4f632cb7a60d3c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family2/24d423930d49469fae4f632cb7a60d3c 2023-11-30 20:55:58,244 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231130b98a436307d74d6898ca7308a25eedb2_del 2023-11-30 20:55:58,245 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130b98a436307d74d6898ca7308a25eedb2_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130b98a436307d74d6898ca7308a25eedb2_del 2023-11-30 20:55:58,340 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb1982501b194b2ea89a15b61ab045fd 2023-11-30 20:55:58,341 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family1/eb1982501b194b2ea89a15b61ab045fd as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/eb1982501b194b2ea89a15b61ab045fd 2023-11-30 20:55:58,377 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for eb1982501b194b2ea89a15b61ab045fd 2023-11-30 20:55:58,378 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ac7a1c004e53268e4385b265a4168677/family1 of ac7a1c004e53268e4385b265a4168677 into eb1982501b194b2ea89a15b61ab045fd(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:58,379 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:55:58,379 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:58,379 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): ac7a1c004e53268e4385b265a4168677/family2 is initiating major compaction (all files) 2023-11-30 20:55:58,379 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:58,380 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:58,380 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of ac7a1c004e53268e4385b265a4168677/family2 in testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:55:58,380 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/9857f6bed1974e8fb22f280b8d4434d4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/2a7aea2f82d648819b026abf6ec544f5, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/404569e6fe0343d39558da9a3954a79f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/c7b4ebfc46da4d9b8b956f8f9a7341f9, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/86e7063b4c6d4e64a75efda81fb32c09] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp, totalSize=25.4 K 2023-11-30 20:55:58,380 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 9857f6bed1974e8fb22f280b8d4434d4, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377747263 2023-11-30 20:55:58,382 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 2a7aea2f82d648819b026abf6ec544f5, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377749150 2023-11-30 20:55:58,382 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 404569e6fe0343d39558da9a3954a79f, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377751034 2023-11-30 20:55:58,383 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting c7b4ebfc46da4d9b8b956f8f9a7341f9, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377752922 2023-11-30 20:55:58,383 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 86e7063b4c6d4e64a75efda81fb32c09, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:58,400 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): ac7a1c004e53268e4385b265a4168677#family2#compaction#201 average throughput is 0.21 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:58,402 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/1a73b936b86d41568ba0e4dcf4712163, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/a649baa7d20a4ae08c83ba15c65f5395, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/21a206d30d324469827412a69210ebb4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/287d211e577d480486afbbce5daa60e6, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/820bf5dfad9548cdb805b4aa60698cfb] to archive 2023-11-30 20:55:58,404 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:58,406 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/1a73b936b86d41568ba0e4dcf4712163 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/1a73b936b86d41568ba0e4dcf4712163 2023-11-30 20:55:58,408 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/a649baa7d20a4ae08c83ba15c65f5395 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/a649baa7d20a4ae08c83ba15c65f5395 2023-11-30 20:55:58,409 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/21a206d30d324469827412a69210ebb4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/21a206d30d324469827412a69210ebb4 2023-11-30 20:55:58,410 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/287d211e577d480486afbbce5daa60e6 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/287d211e577d480486afbbce5daa60e6 2023-11-30 20:55:58,412 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/820bf5dfad9548cdb805b4aa60698cfb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/820bf5dfad9548cdb805b4aa60698cfb 2023-11-30 20:55:58,418 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231130df28fc8f5ce34cd893d2b1aa64100d8f_del 2023-11-30 20:55:58,418 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130df28fc8f5ce34cd893d2b1aa64100d8f_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c81e728d9d4c2f636f067f89cc14862c20231130df28fc8f5ce34cd893d2b1aa64100d8f_del 2023-11-30 20:55:59,233 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa137e17c7814f3a883718d5c0095e08 2023-11-30 20:55:59,234 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/.tmp/family2/aa137e17c7814f3a883718d5c0095e08 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/aa137e17c7814f3a883718d5c0095e08 2023-11-30 20:55:59,238 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for aa137e17c7814f3a883718d5c0095e08 2023-11-30 20:55:59,239 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in ac7a1c004e53268e4385b265a4168677/family2 of ac7a1c004e53268e4385b265a4168677 into aa137e17c7814f3a883718d5c0095e08(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:55:59,239 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:55:59,239 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:55:59,239 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 3ba2330b8c4670c795e548e8c3f7ab18/family1 is initiating major compaction (all files) 2023-11-30 20:55:59,239 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:55:59,239 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:55:59,239 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 3ba2330b8c4670c795e548e8c3f7ab18/family1 in testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:55:59,239 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/2a191e7bcc4e4b00954a586547e0b88a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/6342448908874d63834cf25135104cc7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/bb3f48f3217946309de9dcb4b2a0bfc2, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/f202924f6eec424eb4a44824f05e3b1a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/8462e07ccc444cd8be1d344836817bdd] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp, totalSize=27.1 K 2023-11-30 20:55:59,239 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 2a191e7bcc4e4b00954a586547e0b88a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377747263 2023-11-30 20:55:59,240 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 6342448908874d63834cf25135104cc7, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377749149 2023-11-30 20:55:59,240 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting bb3f48f3217946309de9dcb4b2a0bfc2, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377751034 2023-11-30 20:55:59,240 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting f202924f6eec424eb4a44824f05e3b1a, keycount=4, bloomtype=ROW, size=5.5 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377752922 2023-11-30 20:55:59,241 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 8462e07ccc444cd8be1d344836817bdd, keycount=3, bloomtype=ROW, size=5.2 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:55:59,247 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 3ba2330b8c4670c795e548e8c3f7ab18#family1#compaction#202 average throughput is 0.86 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:55:59,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/9857f6bed1974e8fb22f280b8d4434d4, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/2a7aea2f82d648819b026abf6ec544f5, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/404569e6fe0343d39558da9a3954a79f, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/c7b4ebfc46da4d9b8b956f8f9a7341f9, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/86e7063b4c6d4e64a75efda81fb32c09] to archive 2023-11-30 20:55:59,308 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:55:59,310 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/9857f6bed1974e8fb22f280b8d4434d4 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/9857f6bed1974e8fb22f280b8d4434d4 2023-11-30 20:55:59,311 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/2a7aea2f82d648819b026abf6ec544f5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/2a7aea2f82d648819b026abf6ec544f5 2023-11-30 20:55:59,312 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/404569e6fe0343d39558da9a3954a79f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/404569e6fe0343d39558da9a3954a79f 2023-11-30 20:55:59,313 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/c7b4ebfc46da4d9b8b956f8f9a7341f9 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/c7b4ebfc46da4d9b8b956f8f9a7341f9 2023-11-30 20:55:59,315 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/86e7063b4c6d4e64a75efda81fb32c09 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family2/86e7063b4c6d4e64a75efda81fb32c09 2023-11-30 20:55:59,686 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231130b5dc517a39ce464fbf59b04ee1bf19d5_del 2023-11-30 20:55:59,686 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b20231130b5dc517a39ce464fbf59b04ee1bf19d5_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130b5dc517a39ce464fbf59b04ee1bf19d5_del 2023-11-30 20:56:00,548 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61900d1424d1474aaf91dddda8d9b833 2023-11-30 20:56:00,549 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family1/61900d1424d1474aaf91dddda8d9b833 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/61900d1424d1474aaf91dddda8d9b833 2023-11-30 20:56:00,579 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 61900d1424d1474aaf91dddda8d9b833 2023-11-30 20:56:00,580 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3ba2330b8c4670c795e548e8c3f7ab18/family1 of 3ba2330b8c4670c795e548e8c3f7ab18 into 61900d1424d1474aaf91dddda8d9b833(size=7.0 K), total size for store is 7.0 K. This selection was in queue for 0sec, and took 1sec to execute. 2023-11-30 20:56:00,580 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:56:00,580 DEBUG [Listener at localhost/34291] compactions.SortedCompactionPolicy(75): Selecting compaction from 5 store files, 0 compacting, 5 eligible, 16 blocking 2023-11-30 20:56:00,580 DEBUG [Listener at localhost/34291] regionserver.HStore(1912): 3ba2330b8c4670c795e548e8c3f7ab18/family2 is initiating major compaction (all files) 2023-11-30 20:56:00,580 INFO [Listener at localhost/34291] throttle.PressureAwareCompactionThroughputController(131): Compaction throughput configurations, higher bound: 100.00 MB/second, lower bound 50.00 MB/second, off peak: unlimited, tuning period: 60000 ms 2023-11-30 20:56:00,580 INFO [Listener at localhost/34291] hbase.ChoreService(166): Chore ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS is enabled. 2023-11-30 20:56:00,583 INFO [Listener at localhost/34291] regionserver.HRegion(2259): Starting compaction of 3ba2330b8c4670c795e548e8c3f7ab18/family2 in testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:56:00,583 INFO [Listener at localhost/34291] regionserver.HStore(1468): Starting compaction of [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/b8b9b6d225254a5ab513554544a2d01c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/252bb62cc8254ce7ae3050c8b83ae308, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/58f55743c3b64ce0b8ae49af79b5140d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/a91a1882f8c34878b83663d8ccff9d24, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/053a2e556b32430f9d4aec3d96500170] into tmpdir=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp, totalSize=25.4 K 2023-11-30 20:56:00,583 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting b8b9b6d225254a5ab513554544a2d01c, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=5, earliestPutTs=1701377747263 2023-11-30 20:56:00,584 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 252bb62cc8254ce7ae3050c8b83ae308, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=9, earliestPutTs=1701377749149 2023-11-30 20:56:00,584 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 58f55743c3b64ce0b8ae49af79b5140d, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=13, earliestPutTs=1701377751034 2023-11-30 20:56:00,585 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting a91a1882f8c34878b83663d8ccff9d24, keycount=2, bloomtype=ROW, size=5.1 K, encoding=NONE, compression=NONE, seqNum=17, earliestPutTs=1701377752922 2023-11-30 20:56:00,585 DEBUG [Listener at localhost/34291] compactions.Compactor(207): Compacting 053a2e556b32430f9d4aec3d96500170, keycount=1, bloomtype=ROW, size=5.0 K, encoding=NONE, compression=NONE, seqNum=23, earliestPutTs=9223372036854775807 2023-11-30 20:56:00,603 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/2a191e7bcc4e4b00954a586547e0b88a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/6342448908874d63834cf25135104cc7, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/bb3f48f3217946309de9dcb4b2a0bfc2, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/f202924f6eec424eb4a44824f05e3b1a, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/8462e07ccc444cd8be1d344836817bdd] to archive 2023-11-30 20:56:00,604 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:56:00,607 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/2a191e7bcc4e4b00954a586547e0b88a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/2a191e7bcc4e4b00954a586547e0b88a 2023-11-30 20:56:00,610 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/6342448908874d63834cf25135104cc7 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/6342448908874d63834cf25135104cc7 2023-11-30 20:56:00,611 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/bb3f48f3217946309de9dcb4b2a0bfc2 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/bb3f48f3217946309de9dcb4b2a0bfc2 2023-11-30 20:56:00,613 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/f202924f6eec424eb4a44824f05e3b1a to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/f202924f6eec424eb4a44824f05e3b1a 2023-11-30 20:56:00,614 INFO [Listener at localhost/34291] throttle.PressureAwareThroughputController(145): 3ba2330b8c4670c795e548e8c3f7ab18#family2#compaction#203 average throughput is 0.18 MB/second, slept 0 time(s) and total slept time is 0 ms. 0 active operations remaining, total limit is 50.00 MB/second 2023-11-30 20:56:00,614 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/8462e07ccc444cd8be1d344836817bdd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/8462e07ccc444cd8be1d344836817bdd 2023-11-30 20:56:00,649 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b2023113099966dbb722a40eba0f19491445f8902_del 2023-11-30 20:56:00,649 INFO [Listener at localhost/34291] regionserver.HMobStore(257): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b2023113099966dbb722a40eba0f19491445f8902_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family2/c4ca4238a0b923820dcc509a6f75849b2023113099966dbb722a40eba0f19491445f8902_del 2023-11-30 20:56:00,677 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05fd2951ed574164becce3d9883797c5 2023-11-30 20:56:00,678 DEBUG [Listener at localhost/34291] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/.tmp/family2/05fd2951ed574164becce3d9883797c5 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/05fd2951ed574164becce3d9883797c5 2023-11-30 20:56:00,686 INFO [Listener at localhost/34291] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 05fd2951ed574164becce3d9883797c5 2023-11-30 20:56:00,687 INFO [Listener at localhost/34291] regionserver.HStore(1652): Completed major compaction of 5 (all) file(s) in 3ba2330b8c4670c795e548e8c3f7ab18/family2 of 3ba2330b8c4670c795e548e8c3f7ab18 into 05fd2951ed574164becce3d9883797c5(size=6.2 K), total size for store is 6.2 K. This selection was in queue for 0sec, and took 0sec to execute. 2023-11-30 20:56:00,687 DEBUG [Listener at localhost/34291] regionserver.HRegion(2289): Compaction status journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:56:00,691 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:56:00,695 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:56:00,699 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:56:00,700 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:56:00,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] regionserver.HStore(2712): Moving the files [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/b8b9b6d225254a5ab513554544a2d01c, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/252bb62cc8254ce7ae3050c8b83ae308, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/58f55743c3b64ce0b8ae49af79b5140d, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/a91a1882f8c34878b83663d8ccff9d24, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/053a2e556b32430f9d4aec3d96500170] to archive 2023-11-30 20:56:00,702 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:56:00,707 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/b8b9b6d225254a5ab513554544a2d01c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/b8b9b6d225254a5ab513554544a2d01c 2023-11-30 20:56:00,708 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/252bb62cc8254ce7ae3050c8b83ae308 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/252bb62cc8254ce7ae3050c8b83ae308 2023-11-30 20:56:00,709 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/58f55743c3b64ce0b8ae49af79b5140d to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/58f55743c3b64ce0b8ae49af79b5140d 2023-11-30 20:56:00,710 DEBUG [RpcServer.priority.RWQ.Fifo.read.handler=1,queue=1,port=43087] master.MasterMobCompactionThread(90): The mob compaction is requested for the columns [{NAME => 'family1', ENCRYPTION => 'AES', MOB_THRESHOLD => '0', VERSIONS => '1', KEEP_DELETED_CELLS => 'FALSE', DATA_BLOCK_ENCODING => 'NONE', TTL => 'FOREVER', MIN_VERSIONS => '0', ENCRYPTION_KEY => 'B\x0A\x03AES\x10\x10\x1A\x10\xE6n`T\xB2\xBCz\xEC\xED\xB0\xEF{\xADQ\x12\x83"\x10\xC1\x12l\x9De\x12t\x8EKB")\x98gTZ*\x10\xC9z\x09\xDAl\xF3\xDEB_\x18H\xA96\x0D\x18\xA52\x03MD5', REPLICATION_SCOPE => '0', BLOOMFILTER => 'ROW', IN_MEMORY => 'false', IS_MOB => 'true', COMPRESSION => 'NONE', BLOCKCACHE => 'true', BLOCKSIZE => '65536'}] of the table testMajorCompactionFromAdmin 2023-11-30 20:56:00,719 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/a91a1882f8c34878b83663d8ccff9d24 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/a91a1882f8c34878b83663d8ccff9d24 2023-11-30 20:56:00,721 DEBUG [RS_COMPACTED_FILES_DISCHARGER-regionserver/jenkins-hbase4:0-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/053a2e556b32430f9d4aec3d96500170 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family2/053a2e556b32430f9d4aec3d96500170 2023-11-30 20:56:00,746 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] procedure2.ProcedureExecutor(1075): Stored pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-30 20:56:00,747 DEBUG [PEWorker-3] locking.LockProcedure(309): LOCKED pid=123, state=RUNNABLE; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-30 20:56:00,748 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(833): start MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:56:00,748 INFO [PEWorker-3] procedure2.TimeoutExecutorThread(81): ADDED pid=123, state=WAITING_TIMEOUT, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE; timeout=600000, timestamp=1701378360748 2023-11-30 20:56:00,751 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(142): is allFiles: true 2023-11-30 20:56:01,217 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(306): The compaction type is ALL_FILES, the request has 3 del files, 12 selected files, and 0 irrelevant files table 'testMajorCompactionFromAdmin' and column 'family1' 2023-11-30 20:56:01,243 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d41d8cd98f00b204e9800998ecf8427e20231130f33149c51c1e4302977feb19c9d713d7_del 2023-11-30 20:56:01,271 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c4ca4238a0b923820dcc509a6f75849b20231130b5dc517a39ce464fbf59b04ee1bf19d5_del 2023-11-30 20:56:01,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for c81e728d9d4c2f636f067f89cc14862c20231130b98a436307d74d6898ca7308a25eedb2_del 2023-11-30 20:56:01,296 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(350): After merging, there are 3 del files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-30 20:56:01,296 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] zookeeper.ReadOnlyZKClient(139): Connect 0x18eb025c to 127.0.0.1:58095 with session timeout=90000ms, retries 30, retry interval 1000ms, keepAlive=60000ms 2023-11-30 20:56:01,301 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@5952b2dc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=null 2023-11-30 20:56:01,301 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c4ca4238a0b923820dcc509a6f75849b20231130 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-30 20:56:01,865 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c4ca4238a0b923820dcc509a6f75849b202311303933eb8eddee45808252dacd00a147ec to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b202311303933eb8eddee45808252dacd00a147ec 2023-11-30 20:56:01,866 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231130 table='testMajorCompactionFromAdmin' column='family1' 2023-11-30 20:56:01,877 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=ClientService, sasl=false 2023-11-30 20:56:01,879 INFO [RS-EventLoopGroup-3-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:60876, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=ClientService 2023-11-30 20:56:01,887 DEBUG [MobCompactor-pool-0] ipc.RpcConnection(122): Using SIMPLE authentication for service=MasterService, sasl=false 2023-11-30 20:56:01,889 INFO [RS-EventLoopGroup-1-2] ipc.ServerRpcConnection(540): Connection from 172.31.14.131:43270, version=2.4.18-SNAPSHOT, sasl=false, ugi=jenkins (auth:SIMPLE), service=MasterService 2023-11-30 20:56:01,915 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231130/family1/a317310769804b52b95b670f543723ff first=Optional[1\x00\x00\x00\x01] last=Optional[1\x00\x00\x00\x07] 2023-11-30 20:56:01,915 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row 1 with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231130/family1/a317310769804b52b95b670f543723ff}] 2023-11-30 20:56:01,921 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231130/family1/a317310769804b52b95b670f543723ff for inclusion in 3ba2330b8c4670c795e548e8c3f7ab18/family1 2023-11-30 20:56:01,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=1\x00\x00\x00\x01 last=1\x00\x00\x00\x07 2023-11-30 20:56:01,942 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first=1 last=2 2023-11-30 20:56:01,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:56:01,943 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231130/family1/a317310769804b52b95b670f543723ff to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__he33jji8q8813dcfp3t2a0rubn7g6g50ap4og2mj21unbm99n8gmt1f0ra6tkpap/family1/a317310769804b52b95b670f543723ff 2023-11-30 20:56:01,945 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__he33jji8q8813dcfp3t2a0rubn7g6g50ap4og2mj21unbm99n8gmt1f0ra6tkpap/family1/a317310769804b52b95b670f543723ff as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/71e7b7fe4ecf4c68a687cee551fc6732_SeqId_28_ 2023-11-30 20:56:01,946 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__he33jji8q8813dcfp3t2a0rubn7g6g50ap4og2mj21unbm99n8gmt1f0ra6tkpap/family1/a317310769804b52b95b670f543723ff into 3ba2330b8c4670c795e548e8c3f7ab18/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/71e7b7fe4ecf4c68a687cee551fc6732_SeqId_28_ - updating store file list. 2023-11-30 20:56:01,978 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/71e7b7fe4ecf4c68a687cee551fc6732_SeqId_28_ into 3ba2330b8c4670c795e548e8c3f7ab18/family1 2023-11-30 20:56:01,978 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__he33jji8q8813dcfp3t2a0rubn7g6g50ap4og2mj21unbm99n8gmt1f0ra6tkpap/family1/a317310769804b52b95b670f543723ff into 3ba2330b8c4670c795e548e8c3f7ab18/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/family1/71e7b7fe4ecf4c68a687cee551fc6732_SeqId_28_) 2023-11-30 20:56:01,979 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__he33jji8q8813dcfp3t2a0rubn7g6g50ap4og2mj21unbm99n8gmt1f0ra6tkpap/family1/a317310769804b52b95b670f543723ff 2023-11-30 20:56:01,981 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c4ca4238a0b923820dcc509a6f75849b20231130 table='testMajorCompactionFromAdmin' column='family1' 2023-11-30 20:56:01,981 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:56:01,983 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023113039732cfe818b454e9cb9aa6c1b76a2f0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023113039732cfe818b454e9cb9aa6c1b76a2f0 2023-11-30 20:56:01,984 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023113084b019379bb84251a5eba2fa15ab2697 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b2023113084b019379bb84251a5eba2fa15ab2697 2023-11-30 20:56:01,985 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130b9c9fecc49ae400c929d9a3800b02c75 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130b9c9fecc49ae400c929d9a3800b02c75 2023-11-30 20:56:01,986 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130dfb11cb194ad4a0399c51bcec4c3a67e to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130dfb11cb194ad4a0399c51bcec4c3a67e 2023-11-30 20:56:01,986 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-30 20:56:01,986 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c4ca4238a0b923820dcc509a6f75849b20231130' 2023-11-30 20:56:01,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c4ca4238a0b923820dcc509a6f75849b20231130 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-30 20:56:01,986 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition c81e728d9d4c2f636f067f89cc14862c20231130 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-30 20:56:02,944 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/c81e728d9d4c2f636f067f89cc14862c20231130fb085a3c7fe24e1d97208e6118d020fd to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130fb085a3c7fe24e1d97208e6118d020fd 2023-11-30 20:56:02,945 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='testMajorCompactionFromAdmin' column='family1' 2023-11-30 20:56:02,990 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231130/family1/340ac021537f441c907c16c685fb2e1c first=Optional[2\x00\x00\x00\x01] last=Optional[2\x00\x00\x00\x07] 2023-11-30 20:56:02,991 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row 2 with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231130/family1/340ac021537f441c907c16c685fb2e1c}] 2023-11-30 20:56:02,993 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231130/family1/340ac021537f441c907c16c685fb2e1c for inclusion in ac7a1c004e53268e4385b265a4168677/family1 2023-11-30 20:56:03,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=2\x00\x00\x00\x01 last=2\x00\x00\x00\x07 2023-11-30 20:56:03,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first=2 last= 2023-11-30 20:56:03,014 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:56:03,015 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231130/family1/340ac021537f441c907c16c685fb2e1c to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__pif0kfd90hdk73d4c7ecfrg4tbsd570moapof50hvoodeknh1rqv7pb7m3blme09/family1/340ac021537f441c907c16c685fb2e1c 2023-11-30 20:56:03,017 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__pif0kfd90hdk73d4c7ecfrg4tbsd570moapof50hvoodeknh1rqv7pb7m3blme09/family1/340ac021537f441c907c16c685fb2e1c as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/44b817e2df5a4949a291d95ea9cd2e98_SeqId_28_ 2023-11-30 20:56:03,017 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__pif0kfd90hdk73d4c7ecfrg4tbsd570moapof50hvoodeknh1rqv7pb7m3blme09/family1/340ac021537f441c907c16c685fb2e1c into ac7a1c004e53268e4385b265a4168677/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/44b817e2df5a4949a291d95ea9cd2e98_SeqId_28_ - updating store file list. 2023-11-30 20:56:03,040 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/44b817e2df5a4949a291d95ea9cd2e98_SeqId_28_ into ac7a1c004e53268e4385b265a4168677/family1 2023-11-30 20:56:03,040 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__pif0kfd90hdk73d4c7ecfrg4tbsd570moapof50hvoodeknh1rqv7pb7m3blme09/family1/340ac021537f441c907c16c685fb2e1c into ac7a1c004e53268e4385b265a4168677/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/family1/44b817e2df5a4949a291d95ea9cd2e98_SeqId_28_) 2023-11-30 20:56:03,040 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__pif0kfd90hdk73d4c7ecfrg4tbsd570moapof50hvoodeknh1rqv7pb7m3blme09/family1/340ac021537f441c907c16c685fb2e1c 2023-11-30 20:56:03,042 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition c81e728d9d4c2f636f067f89cc14862c20231130 table='testMajorCompactionFromAdmin' column='family1' 2023-11-30 20:56:03,042 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:56:03,043 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311300ac00ce1174446858b670de9653c4e27 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311300ac00ce1174446858b670de9653c4e27 2023-11-30 20:56:03,044 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311304ecaf149b44e4aa5995a56ecff27038b to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c202311304ecaf149b44e4aa5995a56ecff27038b 2023-11-30 20:56:03,045 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130ae449cce160e4974a4d4fa3eeaa0fbb0 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130ae449cce160e4974a4d4fa3eeaa0fbb0 2023-11-30 20:56:03,046 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130cfa0c90752bc4e41921f20a7ffd19f31 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130cfa0c90752bc4e41921f20a7ffd19f31 2023-11-30 20:56:03,046 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-30 20:56:03,046 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/c81e728d9d4c2f636f067f89cc14862c20231130' 2023-11-30 20:56:03,046 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=c81e728d9d4c2f636f067f89cc14862c20231130 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-30 20:56:03,046 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor$1(495): Compacting mob files for partition d41d8cd98f00b204e9800998ecf8427e20231130 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-30 20:56:03,994 INFO [MobCompactor-pool-0] mob.MobUtils(725): Renaming flushed file from hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/d41d8cd98f00b204e9800998ecf8427e20231130736489debb94446399a8fb88ac70b73f to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231130736489debb94446399a8fb88ac70b73f 2023-11-30 20:56:03,995 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(688): start MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='testMajorCompactionFromAdmin' column='family1' 2023-11-30 20:56:04,034 INFO [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles(788): Trying to load hfile=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231130/family1/5d2d5e6ee3bb4e38b6ebcebb07ff3d44 first=Optional[0\x00\x00\x00\x01] last=Optional[0\x00\x00\x00\x07] 2023-11-30 20:56:04,035 DEBUG [LoadIncrementalHFiles-0] tool.LoadIncrementalHFiles$1(553): Going to connect to server region=testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7., hostname=jenkins-hbase4.apache.org,40365,1701377600631, seqNum=2 for row with hfile group [{family1,hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231130/family1/5d2d5e6ee3bb4e38b6ebcebb07ff3d44}] 2023-11-30 20:56:04,036 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(763): Validating hfile at hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231130/family1/5d2d5e6ee3bb4e38b6ebcebb07ff3d44 for inclusion in 5c8e64d8810f3630e0dc789f524c2bd7/family1 2023-11-30 20:56:04,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(775): HFile bounds: first=0\x00\x00\x00\x01 last=0\x00\x00\x00\x07 2023-11-30 20:56:04,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(777): Region bounds: first= last=1 2023-11-30 20:56:04,057 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegion(2446): Flush status journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:56:04,058 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(386): Moving hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231130/family1/5d2d5e6ee3bb4e38b6ebcebb07ff3d44 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__j1jgcaunsvaqra5e44b5lhj2uqlmmjcs2h6ge2vftlnkclcgqt6kafdaup2hd1tt/family1/5d2d5e6ee3bb4e38b6ebcebb07ff3d44 2023-11-30 20:56:04,060 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__j1jgcaunsvaqra5e44b5lhj2uqlmmjcs2h6ge2vftlnkclcgqt6kafdaup2hd1tt/family1/5d2d5e6ee3bb4e38b6ebcebb07ff3d44 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/e990ca03e680471e9f1e812eeafc7643_SeqId_28_ 2023-11-30 20:56:04,060 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(849): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__j1jgcaunsvaqra5e44b5lhj2uqlmmjcs2h6ge2vftlnkclcgqt6kafdaup2hd1tt/family1/5d2d5e6ee3bb4e38b6ebcebb07ff3d44 into 5c8e64d8810f3630e0dc789f524c2bd7/family1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/e990ca03e680471e9f1e812eeafc7643_SeqId_28_ - updating store file list. 2023-11-30 20:56:04,081 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(882): Loaded HFile hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/e990ca03e680471e9f1e812eeafc7643_SeqId_28_ into 5c8e64d8810f3630e0dc789f524c2bd7/family1 2023-11-30 20:56:04,081 INFO [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.HStore(855): Successfully loaded hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__j1jgcaunsvaqra5e44b5lhj2uqlmmjcs2h6ge2vftlnkclcgqt6kafdaup2hd1tt/family1/5d2d5e6ee3bb4e38b6ebcebb07ff3d44 into 5c8e64d8810f3630e0dc789f524c2bd7/family1 (new location: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/family1/e990ca03e680471e9f1e812eeafc7643_SeqId_28_) 2023-11-30 20:56:04,082 DEBUG [RpcServer.default.FPBQ.Fifo.handler=0,queue=0,port=40365] regionserver.SecureBulkLoadManager$SecureBulkLoadListener(399): Bulk Load done for: hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/staging/jenkins__testMajorCompactionFromAdmin__j1jgcaunsvaqra5e44b5lhj2uqlmmjcs2h6ge2vftlnkclcgqt6kafdaup2hd1tt/family1/5d2d5e6ee3bb4e38b6ebcebb07ff3d44 2023-11-30 20:56:04,083 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(692): end MOB ref bulkload for partition d41d8cd98f00b204e9800998ecf8427e20231130 table='testMajorCompactionFromAdmin' column='family1' 2023-11-30 20:56:04,084 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:56:04,085 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023113009c361b90ca4486a85426393384c1cf5 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023113009c361b90ca4486a85426393384c1cf5 2023-11-30 20:56:04,086 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231130462392c1b51744b2ade63298ceb05255 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231130462392c1b51744b2ade63298ceb05255 2023-11-30 20:56:04,087 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023113060d3b2f766e045d081e667be52c18cdb to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e2023113060d3b2f766e045d081e667be52c18cdb 2023-11-30 20:56:04,088 DEBUG [MobCompactor-pool-0] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311309ef29f4722b04f52becca4a6e2c9f649 to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e202311309ef29f4722b04f52becca4a6e2c9f649 2023-11-30 20:56:04,088 INFO [MobCompactor-pool-0] mob.MobUtils(508): Table testMajorCompactionFromAdmin 4 expired mob files are deleted 2023-11-30 20:56:04,088 DEBUG [MobCompactor-pool-0] compactions.PartitionedMobCompactor(917): Cleanup, delete path 'hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/.tmp/.bulkload/default/testMajorCompactionFromAdmin/d41d8cd98f00b204e9800998ecf8427e20231130' 2023-11-30 20:56:04,088 INFO [MobCompactor-pool-0] compactions.PartitionedMobCompactor(582): Compaction is finished. The number of mob files is changed from 4 to 1 for partition=d41d8cd98f00b204e9800998ecf8427e20231130 for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-30 20:56:04,088 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(354): After compaction, there are 3 mob files. table='testMajorCompactionFromAdmin' column='family1' 2023-11-30 20:56:04,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(364): After a mob compaction with all files selected, archiving the del files for table='testMajorCompactionFromAdmin' and column='family1' 2023-11-30 20:56:04,089 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231130f33149c51c1e4302977feb19c9d713d7_del] 2023-11-30 20:56:04,089 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:56:04,090 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231130f33149c51c1e4302977feb19c9d713d7_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/d41d8cd98f00b204e9800998ecf8427e20231130f33149c51c1e4302977feb19c9d713d7_del 2023-11-30 20:56:04,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-30 20:56:04,090 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130b5dc517a39ce464fbf59b04ee1bf19d5_del] 2023-11-30 20:56:04,091 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:56:04,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130b5dc517a39ce464fbf59b04ee1bf19d5_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c4ca4238a0b923820dcc509a6f75849b20231130b5dc517a39ce464fbf59b04ee1bf19d5_del 2023-11-30 20:56:04,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-30 20:56:04,092 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] compactions.PartitionedMobCompactor(367): [hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130b98a436307d74d6898ca7308a25eedb2_del] 2023-11-30 20:56:04,092 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] backup.HFileArchiver(360): Archiving compacted files. 2023-11-30 20:56:04,093 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] backup.HFileArchiver(582): Archived from FileableStoreFile, hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/mobdir/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130b98a436307d74d6898ca7308a25eedb2_del to hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/archive/data/default/testMajorCompactionFromAdmin/85b2cf7da420f757b7327e61350f7918/family1/c81e728d9d4c2f636f067f89cc14862c20231130b98a436307d74d6898ca7308a25eedb2_del 2023-11-30 20:56:04,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(508): Table testMajorCompactionFromAdmin 1 expired mob files are deleted 2023-11-30 20:56:04,093 INFO [master/jenkins-hbase4:0:becomeActiveMaster-MasterMobCompaction-1701377604330] mob.MobUtils(840): end MOB compaction of files for table='testMajorCompactionFromAdmin', column='family1', allFiles=true, compactor='class org.apache.hadoop.hbase.mob.compactions.PartitionedMobCompactor' 2023-11-30 20:56:04,094 DEBUG [PEWorker-2] locking.LockProcedure(242): UNLOCKED pid=123, state=RUNNABLE, locked=true; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE 2023-11-30 20:56:04,095 INFO [PEWorker-2] procedure2.ProcedureExecutor(1457): Finished pid=123, state=SUCCESS; org.apache.hadoop.hbase.master.locking.LockProcedure, tableName=testMajorCompactionFromAdmin.mobLock, type=EXCLUSIVE in 3.3490 sec 2023-11-30 20:56:04,114 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:56:04,116 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:56:04,118 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '1', inclusive 2023-11-30 20:56:04,119 DEBUG [Listener at localhost/34291] client.ClientScanner(240): Advancing internal scanner to startKey at '2', inclusive 2023-11-30 20:56:04,123 INFO [Listener at localhost/34291] fs.HFileSystem(337): Added intercepting call to namenode#getBlockLocations so can do block reordering using class org.apache.hadoop.hbase.fs.HFileSystem$ReorderWALBlocks 2023-11-30 20:56:04,158 INFO [Listener at localhost/34291] hbase.ResourceChecker(175): after: mob.compactions.TestMobCompactor#testMajorCompactionFromAdmin Thread=250 (was 261), OpenFileDescriptor=660 (was 678), MaxFileDescriptor=60000 (was 60000), SystemLoadAverage=234 (was 181) - SystemLoadAverage LEAK? -, ProcessCount=172 (was 172), AvailableMemoryMB=7054 (was 7667) 2023-11-30 20:56:04,158 DEBUG [Listener at localhost/34291] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0a11c17b to 127.0.0.1:58095 2023-11-30 20:56:04,158 DEBUG [Listener at localhost/34291] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:56:04,159 INFO [Listener at localhost/34291] hbase.HBaseTestingUtility(1286): Shutting down minicluster 2023-11-30 20:56:04,159 INFO [Listener at localhost/34291] client.ConnectionImplementation(1973): Closing master protocol: MasterService 2023-11-30 20:56:04,159 DEBUG [Listener at localhost/34291] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x77fd41f4 to 127.0.0.1:58095 2023-11-30 20:56:04,159 DEBUG [Listener at localhost/34291] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:56:04,159 DEBUG [Listener at localhost/34291] util.JVMClusterUtil(237): Shutting down HBase Cluster 2023-11-30 20:56:04,159 DEBUG [Listener at localhost/34291] util.JVMClusterUtil(257): Found active master hash=1858517703, stopped=false 2023-11-30 20:56:04,159 INFO [Listener at localhost/34291] master.ServerManager(888): Cluster shutdown requested of master=jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:56:04,162 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-30 20:56:04,162 INFO [Listener at localhost/34291] procedure2.ProcedureExecutor(675): Stopping 2023-11-30 20:56:04,162 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:56:04,162 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/running 2023-11-30 20:56:04,162 DEBUG [Listener at localhost/34291] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x70bfacde to 127.0.0.1:58095 2023-11-30 20:56:04,162 DEBUG [Listener at localhost/34291] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:56:04,162 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-30 20:56:04,162 INFO [Listener at localhost/34291] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,40365,1701377600631' ***** 2023-11-30 20:56:04,163 INFO [Listener at localhost/34291] regionserver.HRegionServer(2314): STOPPED: Shutdown requested 2023-11-30 20:56:04,163 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/running 2023-11-30 20:56:04,163 INFO [RS:0;jenkins-hbase4:40365] regionserver.HeapMemoryManager(220): Stopping 2023-11-30 20:56:04,163 INFO [RS:0;jenkins-hbase4:40365] flush.RegionServerFlushTableProcedureManager(117): Stopping region server flush procedure manager gracefully. 2023-11-30 20:56:04,163 INFO [MemStoreFlusher.0] regionserver.MemStoreFlusher$FlushHandler(361): MemStoreFlusher.0 exiting 2023-11-30 20:56:04,163 INFO [RS:0;jenkins-hbase4:40365] snapshot.RegionServerSnapshotManager(137): Stopping RegionServerSnapshotManager gracefully. 2023-11-30 20:56:04,163 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for bcfdcc2a31ec9769a470e90ff3f01299 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 01ed825bd99347cac3dd87faa7414ea1 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 0ea9609bce6110fb1313e1d0e5a83ef8 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 92b8e7e210d6609106b2d5a4e07ee576 2023-11-30 20:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing bcfdcc2a31ec9769a470e90ff3f01299, disabling compactions & flushes 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for f061586794c0e3921942a081e9bc09d2 2023-11-30 20:56:04,164 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 403bb60689734a0b812ff8d53e9885e9 2023-11-30 20:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 5c8e64d8810f3630e0dc789f524c2bd7 2023-11-30 20:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. after waiting 0 ms 2023-11-30 20:56:04,164 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for ac7a1c004e53268e4385b265a4168677 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for a3704dc0ee835a16ce967a1d260044ee 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for fce206c3d63220a0b9fcc84f3f5ad56b 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 3ba2330b8c4670c795e548e8c3f7ab18 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 691aa403271da0d28d3018e7aaa1107d 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 550ab1f8254e7dfd3c43a65727cb6840 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 500368a3308cef6169186b92cc3c99de 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for dbe2ffe15100d5001cccf687e059cd41 2023-11-30 20:56:04,164 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 3361defc3633e70b83e7f7d3d89134c7 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for ff44000446a9095d68151bec61f51230 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 5d30e55ca1973483a8d458e94f66df94 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 96c3a18970b703bdfa44f3ff7e91565f 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 459120585a3b68683a2916d188707129 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:56:04,165 DEBUG [RS:0;jenkins-hbase4:40365] zookeeper.ReadOnlyZKClient(361): Close zookeeper connection 0x0ed9b448 to 127.0.0.1:58095 2023-11-30 20:56:04,165 DEBUG [RS:0;jenkins-hbase4:40365] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.CompactSplit(434): Waiting for Split Thread to finish... 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.CompactSplit(434): Waiting for Large Compaction Thread to finish... 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.CompactSplit(434): Waiting for Small Compaction Thread to finish... 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(3308): Received CLOSE for 1588230740 2023-11-30 20:56:04,165 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1477): Waiting on 21 regions to close 2023-11-30 20:56:04,166 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 1588230740, disabling compactions & flushes 2023-11-30 20:56:04,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:meta,,1.1588230740 2023-11-30 20:56:04,166 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:meta,,1.1588230740 2023-11-30 20:56:04,166 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:meta,,1.1588230740 after waiting 0 ms 2023-11-30 20:56:04,166 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:meta,,1.1588230740 2023-11-30 20:56:04,166 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing 1588230740 3/3 column families, dataSize=50.56 KB heapSize=78.23 KB 2023-11-30 20:56:04,166 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1507): Waiting on 01ed825bd99347cac3dd87faa7414ea1, 0ea9609bce6110fb1313e1d0e5a83ef8, 1588230740, 3361defc3633e70b83e7f7d3d89134c7, 3ba2330b8c4670c795e548e8c3f7ab18, 403bb60689734a0b812ff8d53e9885e9, 459120585a3b68683a2916d188707129, 500368a3308cef6169186b92cc3c99de, 550ab1f8254e7dfd3c43a65727cb6840, 5c8e64d8810f3630e0dc789f524c2bd7, 5d30e55ca1973483a8d458e94f66df94, 691aa403271da0d28d3018e7aaa1107d, 92b8e7e210d6609106b2d5a4e07ee576, 96c3a18970b703bdfa44f3ff7e91565f, a3704dc0ee835a16ce967a1d260044ee, ac7a1c004e53268e4385b265a4168677, bcfdcc2a31ec9769a470e90ff3f01299, dbe2ffe15100d5001cccf687e059cd41, f061586794c0e3921942a081e9bc09d2, fce206c3d63220a0b9fcc84f3f5ad56b, ff44000446a9095d68151bec61f51230 2023-11-30 20:56:04,168 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/bcfdcc2a31ec9769a470e90ff3f01299/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-30 20:56:04,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:56:04,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for bcfdcc2a31ec9769a470e90ff3f01299: 2023-11-30 20:56:04,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,1,1701377716252.bcfdcc2a31ec9769a470e90ff3f01299. 2023-11-30 20:56:04,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 01ed825bd99347cac3dd87faa7414ea1, disabling compactions & flushes 2023-11-30 20:56:04,169 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:56:04,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:56:04,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. after waiting 0 ms 2023-11-30 20:56:04,169 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:56:04,172 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/01ed825bd99347cac3dd87faa7414ea1/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-30 20:56:04,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:56:04,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 01ed825bd99347cac3dd87faa7414ea1: 2023-11-30 20:56:04,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,2,1701377693294.01ed825bd99347cac3dd87faa7414ea1. 2023-11-30 20:56:04,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 0ea9609bce6110fb1313e1d0e5a83ef8, disabling compactions & flushes 2023-11-30 20:56:04,175 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:56:04,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:56:04,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. after waiting 0 ms 2023-11-30 20:56:04,175 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:56:04,176 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=48.28 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/.tmp/info/88af3fd371af4566a942ae4d0fec2039 2023-11-30 20:56:04,178 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/0ea9609bce6110fb1313e1d0e5a83ef8/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-30 20:56:04,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:56:04,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 0ea9609bce6110fb1313e1d0e5a83ef8: 2023-11-30 20:56:04,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,1,1701377693294.0ea9609bce6110fb1313e1d0e5a83ef8. 2023-11-30 20:56:04,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 92b8e7e210d6609106b2d5a4e07ee576, disabling compactions & flushes 2023-11-30 20:56:04,179 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:56:04,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:56:04,179 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. after waiting 0 ms 2023-11-30 20:56:04,180 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:56:04,180 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88af3fd371af4566a942ae4d0fec2039 2023-11-30 20:56:04,182 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/92b8e7e210d6609106b2d5a4e07ee576/recovered.edits/15.seqid, newMaxSeqId=15, maxSeqId=1 2023-11-30 20:56:04,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:56:04,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 92b8e7e210d6609106b2d5a4e07ee576: 2023-11-30 20:56:04,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,2,1701377639574.92b8e7e210d6609106b2d5a4e07ee576. 2023-11-30 20:56:04,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing f061586794c0e3921942a081e9bc09d2, disabling compactions & flushes 2023-11-30 20:56:04,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:56:04,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:56:04,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. after waiting 0 ms 2023-11-30 20:56:04,183 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:56:04,183 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2745): Flushing f061586794c0e3921942a081e9bc09d2 1/1 column families, dataSize=109 B heapSize=592 B 2023-11-30 20:56:04,188 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=102 B at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/.tmp/rep_barrier/d2a8d1a5a02d458eac3d784bac28e754 2023-11-30 20:56:04,191 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2a8d1a5a02d458eac3d784bac28e754 2023-11-30 20:56:04,201 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactedHFilesCleaner was stopped 2023-11-30 20:56:04,212 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: MemstoreFlusherChore was stopped 2023-11-30 20:56:04,212 INFO [regionserver/jenkins-hbase4:0.Chore.1] hbase.ScheduledChore(146): Chore: CompactionChecker was stopped 2023-11-30 20:56:04,256 INFO [regionserver/jenkins-hbase4:0.leaseChecker] regionserver.LeaseManager(133): Closed leases 2023-11-30 20:56:04,366 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1507): Waiting on 1588230740, 3361defc3633e70b83e7f7d3d89134c7, 3ba2330b8c4670c795e548e8c3f7ab18, 403bb60689734a0b812ff8d53e9885e9, 459120585a3b68683a2916d188707129, 500368a3308cef6169186b92cc3c99de, 550ab1f8254e7dfd3c43a65727cb6840, 5c8e64d8810f3630e0dc789f524c2bd7, 5d30e55ca1973483a8d458e94f66df94, 691aa403271da0d28d3018e7aaa1107d, 96c3a18970b703bdfa44f3ff7e91565f, a3704dc0ee835a16ce967a1d260044ee, ac7a1c004e53268e4385b265a4168677, dbe2ffe15100d5001cccf687e059cd41, f061586794c0e3921942a081e9bc09d2, fce206c3d63220a0b9fcc84f3f5ad56b, ff44000446a9095d68151bec61f51230 2023-11-30 20:56:04,567 DEBUG [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1507): Waiting on 1588230740, 3361defc3633e70b83e7f7d3d89134c7, 3ba2330b8c4670c795e548e8c3f7ab18, 403bb60689734a0b812ff8d53e9885e9, 459120585a3b68683a2916d188707129, 500368a3308cef6169186b92cc3c99de, 550ab1f8254e7dfd3c43a65727cb6840, 5c8e64d8810f3630e0dc789f524c2bd7, 5d30e55ca1973483a8d458e94f66df94, 691aa403271da0d28d3018e7aaa1107d, 96c3a18970b703bdfa44f3ff7e91565f, a3704dc0ee835a16ce967a1d260044ee, ac7a1c004e53268e4385b265a4168677, dbe2ffe15100d5001cccf687e059cd41, f061586794c0e3921942a081e9bc09d2, fce206c3d63220a0b9fcc84f3f5ad56b, ff44000446a9095d68151bec61f51230 2023-11-30 20:56:04,591 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=109 B at sequenceid=7 (bloomFilter=true), to=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2/.tmp/info/36480fefdafa46819e2dd559a6f4653a 2023-11-30 20:56:04,595 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2/.tmp/info/36480fefdafa46819e2dd559a6f4653a as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2/info/36480fefdafa46819e2dd559a6f4653a 2023-11-30 20:56:04,599 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2/info/36480fefdafa46819e2dd559a6f4653a, entries=3, sequenceid=7, filesize=4.8 K 2023-11-30 20:56:04,600 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~109 B/109, heapSize ~576 B/576, currentSize=0 B/0 for f061586794c0e3921942a081e9bc09d2 in 417ms, sequenceid=7, compaction requested=false 2023-11-30 20:56:04,601 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=2.18 KB at sequenceid=130 (bloomFilter=false), to=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/.tmp/table/42d5f1349db54b91a32f25df3c4fe2f8 2023-11-30 20:56:04,603 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/namespace/f061586794c0e3921942a081e9bc09d2/recovered.edits/10.seqid, newMaxSeqId=10, maxSeqId=1 2023-11-30 20:56:04,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:56:04,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for f061586794c0e3921942a081e9bc09d2: 2023-11-30 20:56:04,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:namespace,,1701377602821.f061586794c0e3921942a081e9bc09d2. 2023-11-30 20:56:04,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 403bb60689734a0b812ff8d53e9885e9, disabling compactions & flushes 2023-11-30 20:56:04,604 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:56:04,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:56:04,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. after waiting 0 ms 2023-11-30 20:56:04,604 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:56:04,605 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42d5f1349db54b91a32f25df3c4fe2f8 2023-11-30 20:56:04,605 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/.tmp/info/88af3fd371af4566a942ae4d0fec2039 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/info/88af3fd371af4566a942ae4d0fec2039 2023-11-30 20:56:04,607 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testCompactionWithHFileLink/403bb60689734a0b812ff8d53e9885e9/recovered.edits/38.seqid, newMaxSeqId=38, maxSeqId=31 2023-11-30 20:56:04,608 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:56:04,608 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 403bb60689734a0b812ff8d53e9885e9: 2023-11-30 20:56:04,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testCompactionWithHFileLink,,1701377693294.403bb60689734a0b812ff8d53e9885e9. 2023-11-30 20:56:04,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5c8e64d8810f3630e0dc789f524c2bd7, disabling compactions & flushes 2023-11-30 20:56:04,609 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:56:04,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:56:04,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. after waiting 0 ms 2023-11-30 20:56:04,609 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:56:04,609 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 88af3fd371af4566a942ae4d0fec2039 2023-11-30 20:56:04,609 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/info/88af3fd371af4566a942ae4d0fec2039, entries=226, sequenceid=130, filesize=37.9 K 2023-11-30 20:56:04,610 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/.tmp/rep_barrier/d2a8d1a5a02d458eac3d784bac28e754 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/rep_barrier/d2a8d1a5a02d458eac3d784bac28e754 2023-11-30 20:56:04,612 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/5c8e64d8810f3630e0dc789f524c2bd7/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-30 20:56:04,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:56:04,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5c8e64d8810f3630e0dc789f524c2bd7: 2023-11-30 20:56:04,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,,1701377745101.5c8e64d8810f3630e0dc789f524c2bd7. 2023-11-30 20:56:04,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ac7a1c004e53268e4385b265a4168677, disabling compactions & flushes 2023-11-30 20:56:04,613 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:56:04,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:56:04,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. after waiting 0 ms 2023-11-30 20:56:04,613 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:56:04,614 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for d2a8d1a5a02d458eac3d784bac28e754 2023-11-30 20:56:04,614 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/rep_barrier/d2a8d1a5a02d458eac3d784bac28e754, entries=1, sequenceid=130, filesize=5.0 K 2023-11-30 20:56:04,614 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/.tmp/table/42d5f1349db54b91a32f25df3c4fe2f8 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/table/42d5f1349db54b91a32f25df3c4fe2f8 2023-11-30 20:56:04,616 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/ac7a1c004e53268e4385b265a4168677/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-30 20:56:04,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:56:04,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ac7a1c004e53268e4385b265a4168677: 2023-11-30 20:56:04,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,2,1701377745101.ac7a1c004e53268e4385b265a4168677. 2023-11-30 20:56:04,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing a3704dc0ee835a16ce967a1d260044ee, disabling compactions & flushes 2023-11-30 20:56:04,617 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:56:04,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:56:04,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. after waiting 0 ms 2023-11-30 20:56:04,617 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:56:04,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 42d5f1349db54b91a32f25df3c4fe2f8 2023-11-30 20:56:04,618 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/table/42d5f1349db54b91a32f25df3c4fe2f8, entries=27, sequenceid=130, filesize=6.6 K 2023-11-30 20:56:04,620 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(2948): Finished flush of dataSize ~50.56 KB/51772, heapSize ~78.19 KB/80064, currentSize=0 B/0 for 1588230740 in 454ms, sequenceid=130, compaction requested=false 2023-11-30 20:56:04,621 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/a3704dc0ee835a16ce967a1d260044ee/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-30 20:56:04,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:56:04,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for a3704dc0ee835a16ce967a1d260044ee: 2023-11-30 20:56:04,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,2,1701377716252.a3704dc0ee835a16ce967a1d260044ee. 2023-11-30 20:56:04,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing fce206c3d63220a0b9fcc84f3f5ad56b, disabling compactions & flushes 2023-11-30 20:56:04,622 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:56:04,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:56:04,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. after waiting 0 ms 2023-11-30 20:56:04,622 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:56:04,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/hbase/meta/1588230740/recovered.edits/133.seqid, newMaxSeqId=133, maxSeqId=1 2023-11-30 20:56:04,629 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly/fce206c3d63220a0b9fcc84f3f5ad56b/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-30 20:56:04,629 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] coprocessor.CoprocessorHost(310): Stop coprocessor org.apache.hadoop.hbase.coprocessor.MultiRowMutationEndpoint 2023-11-30 20:56:04,630 INFO [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed hbase:meta,,1.1588230740 2023-11-30 20:56:04,630 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 1588230740: 2023-11-30 20:56:04,630 DEBUG [RS_CLOSE_META-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed hbase:meta,,1.1588230740 2023-11-30 20:56:04,630 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:56:04,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for fce206c3d63220a0b9fcc84f3f5ad56b: 2023-11-30 20:56:04,630 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByWeekly,,1701377655945.fce206c3d63220a0b9fcc84f3f5ad56b. 2023-11-30 20:56:04,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3ba2330b8c4670c795e548e8c3f7ab18, disabling compactions & flushes 2023-11-30 20:56:04,631 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:56:04,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:56:04,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. after waiting 0 ms 2023-11-30 20:56:04,631 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:56:04,633 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionFromAdmin/3ba2330b8c4670c795e548e8c3f7ab18/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-30 20:56:04,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:56:04,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3ba2330b8c4670c795e548e8c3f7ab18: 2023-11-30 20:56:04,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionFromAdmin,1,1701377745101.3ba2330b8c4670c795e548e8c3f7ab18. 2023-11-30 20:56:04,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 691aa403271da0d28d3018e7aaa1107d, disabling compactions & flushes 2023-11-30 20:56:04,634 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:56:04,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:56:04,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. after waiting 0 ms 2023-11-30 20:56:04,634 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:56:04,637 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithMonthlyPolicy/691aa403271da0d28d3018e7aaa1107d/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-30 20:56:04,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:56:04,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 691aa403271da0d28d3018e7aaa1107d: 2023-11-30 20:56:04,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithMonthlyPolicy,,1701377733509.691aa403271da0d28d3018e7aaa1107d. 2023-11-30 20:56:04,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 550ab1f8254e7dfd3c43a65727cb6840, disabling compactions & flushes 2023-11-30 20:56:04,638 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:56:04,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:56:04,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. after waiting 0 ms 2023-11-30 20:56:04,638 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:56:04,640 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/550ab1f8254e7dfd3c43a65727cb6840/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-30 20:56:04,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:56:04,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 550ab1f8254e7dfd3c43a65727cb6840: 2023-11-30 20:56:04,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,,1701377639574.550ab1f8254e7dfd3c43a65727cb6840. 2023-11-30 20:56:04,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 500368a3308cef6169186b92cc3c99de, disabling compactions & flushes 2023-11-30 20:56:04,641 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:56:04,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:56:04,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. after waiting 0 ms 2023-11-30 20:56:04,641 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:56:04,644 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyPolicy/500368a3308cef6169186b92cc3c99de/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-30 20:56:04,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:56:04,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 500368a3308cef6169186b92cc3c99de: 2023-11-30 20:56:04,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyPolicy,,1701377643805.500368a3308cef6169186b92cc3c99de. 2023-11-30 20:56:04,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing dbe2ffe15100d5001cccf687e059cd41, disabling compactions & flushes 2023-11-30 20:56:04,645 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:56:04,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:56:04,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. after waiting 0 ms 2023-11-30 20:56:04,645 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:56:04,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily/dbe2ffe15100d5001cccf687e059cd41/recovered.edits/58.seqid, newMaxSeqId=58, maxSeqId=55 2023-11-30 20:56:04,648 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:56:04,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for dbe2ffe15100d5001cccf687e059cd41: 2023-11-30 20:56:04,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthlyFollowedByDaily,,1701377672271.dbe2ffe15100d5001cccf687e059cd41. 2023-11-30 20:56:04,648 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 3361defc3633e70b83e7f7d3d89134c7, disabling compactions & flushes 2023-11-30 20:56:04,649 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:56:04,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:56:04,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. after waiting 0 ms 2023-11-30 20:56:04,649 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:56:04,651 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testScannerOnBulkLoadRefHFiles/3361defc3633e70b83e7f7d3d89134c7/recovered.edits/6.seqid, newMaxSeqId=6, maxSeqId=1 2023-11-30 20:56:04,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:56:04,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 3361defc3633e70b83e7f7d3d89134c7: 2023-11-30 20:56:04,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testScannerOnBulkLoadRefHFiles,1,1701377639574.3361defc3633e70b83e7f7d3d89134c7. 2023-11-30 20:56:04,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing ff44000446a9095d68151bec61f51230, disabling compactions & flushes 2023-11-30 20:56:04,652 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:56:04,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:56:04,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. after waiting 0 ms 2023-11-30 20:56:04,652 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:56:04,655 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithMonthlyPolicy/ff44000446a9095d68151bec61f51230/recovered.edits/52.seqid, newMaxSeqId=52, maxSeqId=1 2023-11-30 20:56:04,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:56:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for ff44000446a9095d68151bec61f51230: 2023-11-30 20:56:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithMonthlyPolicy,,1701377617197.ff44000446a9095d68151bec61f51230. 2023-11-30 20:56:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 5d30e55ca1973483a8d458e94f66df94, disabling compactions & flushes 2023-11-30 20:56:04,656 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:56:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:56:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. after waiting 0 ms 2023-11-30 20:56:04,656 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:56:04,660 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/ns/testMinorCompaction/5d30e55ca1973483a8d458e94f66df94/recovered.edits/30.seqid, newMaxSeqId=30, maxSeqId=1 2023-11-30 20:56:04,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:56:04,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 5d30e55ca1973483a8d458e94f66df94: 2023-11-30 20:56:04,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed ns:testMinorCompaction,,1701377716252.5d30e55ca1973483a8d458e94f66df94. 2023-11-30 20:56:04,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 96c3a18970b703bdfa44f3ff7e91565f, disabling compactions & flushes 2023-11-30 20:56:04,661 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:56:04,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:56:04,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. after waiting 0 ms 2023-11-30 20:56:04,661 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:56:04,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMinorCompactionWithWeeklyPolicy/96c3a18970b703bdfa44f3ff7e91565f/recovered.edits/50.seqid, newMaxSeqId=50, maxSeqId=1 2023-11-30 20:56:04,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:56:04,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 96c3a18970b703bdfa44f3ff7e91565f: 2023-11-30 20:56:04,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMinorCompactionWithWeeklyPolicy,,1701377627176.96c3a18970b703bdfa44f3ff7e91565f. 2023-11-30 20:56:04,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1604): Closing 459120585a3b68683a2916d188707129, disabling compactions & flushes 2023-11-30 20:56:04,664 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1626): Closing region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:56:04,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1647): Waiting without time limit for close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:56:04,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1714): Acquired close lock on testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. after waiting 0 ms 2023-11-30 20:56:04,664 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1724): Updates disabled for region testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:56:04,668 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] wal.WALSplitUtil(408): Wrote file=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/data/default/testMajorCompactionWithWeeklyFollowedByMonthly/459120585a3b68683a2916d188707129/recovered.edits/55.seqid, newMaxSeqId=55, maxSeqId=50 2023-11-30 20:56:04,669 INFO [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1838): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:56:04,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] regionserver.HRegion(1558): Region close journal for 459120585a3b68683a2916d188707129: 2023-11-30 20:56:04,669 DEBUG [RS_CLOSE_REGION-regionserver/jenkins-hbase4:0-0] handler.CloseRegionHandler(117): Closed testMajorCompactionWithWeeklyFollowedByMonthly,,1701377604503.459120585a3b68683a2916d188707129. 2023-11-30 20:56:04,767 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,40365,1701377600631; all regions closed. 2023-11-30 20:56:04,774 DEBUG [RS:0;jenkins-hbase4:40365] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/oldWALs 2023-11-30 20:56:04,774 INFO [RS:0;jenkins-hbase4:40365] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40365%2C1701377600631.meta:.meta(num 1701377602552) 2023-11-30 20:56:04,778 DEBUG [RS:0;jenkins-hbase4:40365] wal.AbstractFSWAL(1028): Moved 1 WAL file(s) to /user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/oldWALs 2023-11-30 20:56:04,778 INFO [RS:0;jenkins-hbase4:40365] wal.AbstractFSWAL(1031): Closed WAL: AsyncFSWAL jenkins-hbase4.apache.org%2C40365%2C1701377600631:(num 1701377602363) 2023-11-30 20:56:04,778 DEBUG [RS:0;jenkins-hbase4:40365] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:56:04,778 INFO [RS:0;jenkins-hbase4:40365] regionserver.LeaseManager(133): Closed leases 2023-11-30 20:56:04,778 INFO [RS:0;jenkins-hbase4:40365] hbase.ChoreService(369): Chore service for: regionserver/jenkins-hbase4:0 had [ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS, ScheduledChore name=CompactionThroughputTuner, period=60000, unit=MILLISECONDS] on shutdown 2023-11-30 20:56:04,779 INFO [regionserver/jenkins-hbase4:0.logRoller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-30 20:56:04,780 INFO [RS:0;jenkins-hbase4:40365] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:40365 2023-11-30 20:56:04,787 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/rs/jenkins-hbase4.apache.org,40365,1701377600631 2023-11-30 20:56:04,787 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-30 20:56:04,787 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase/rs 2023-11-30 20:56:04,789 INFO [RegionServerTracker-0] master.RegionServerTracker(179): RegionServer ephemeral node deleted, processing expiration [jenkins-hbase4.apache.org,40365,1701377600631] 2023-11-30 20:56:04,789 DEBUG [RegionServerTracker-0] master.DeadServer(103): Processing jenkins-hbase4.apache.org,40365,1701377600631; numProcessing=1 2023-11-30 20:56:04,792 DEBUG [RegionServerTracker-0] zookeeper.RecoverableZooKeeper(172): Node /hbase/draining/jenkins-hbase4.apache.org,40365,1701377600631 already deleted, retry=false 2023-11-30 20:56:04,792 INFO [RegionServerTracker-0] master.ServerManager(554): Cluster shutdown set; jenkins-hbase4.apache.org,40365,1701377600631 expired; onlineServers=0 2023-11-30 20:56:04,792 INFO [RegionServerTracker-0] regionserver.HRegionServer(2300): ***** STOPPING region server 'jenkins-hbase4.apache.org,43087,1701377599413' ***** 2023-11-30 20:56:04,792 INFO [RegionServerTracker-0] regionserver.HRegionServer(2314): STOPPED: Cluster shutdown set; onlineServer=0 2023-11-30 20:56:04,792 DEBUG [M:0;jenkins-hbase4:43087] ipc.AbstractRpcClient(189): Codec=org.apache.hadoop.hbase.codec.KeyValueCodec@2ffbb0fc, compressor=null, tcpKeepAlive=true, tcpNoDelay=true, connectTO=10000, readTO=20000, writeTO=60000, minIdleTimeBeforeClose=120000, maxRetries=0, fallbackAllowed=true, bind address=jenkins-hbase4.apache.org/172.31.14.131:0 2023-11-30 20:56:04,792 INFO [M:0;jenkins-hbase4:43087] regionserver.HRegionServer(1147): stopping server jenkins-hbase4.apache.org,43087,1701377599413 2023-11-30 20:56:04,792 INFO [M:0;jenkins-hbase4:43087] regionserver.HRegionServer(1173): stopping server jenkins-hbase4.apache.org,43087,1701377599413; all regions closed. 2023-11-30 20:56:04,792 DEBUG [M:0;jenkins-hbase4:43087] ipc.AbstractRpcClient(489): Stopping rpc client 2023-11-30 20:56:04,792 DEBUG [M:0;jenkins-hbase4:43087] cleaner.LogCleaner(198): Cancelling LogCleaner 2023-11-30 20:56:04,792 WARN [OldWALsCleaner-0] cleaner.LogCleaner(186): Interrupted while cleaning old WALs, will try to clean it next round. Exiting. 2023-11-30 20:56:04,793 DEBUG [M:0;jenkins-hbase4:43087] cleaner.HFileCleaner(317): Stopping file delete threads 2023-11-30 20:56:04,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701377602069] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.large.0-1701377602069,5,FailOnTimeoutGroup] 2023-11-30 20:56:04,793 DEBUG [master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701377602071] cleaner.HFileCleaner(288): Exit Thread[master/jenkins-hbase4:0:becomeActiveMaster-HFileCleaner.small.0-1701377602071,5,FailOnTimeoutGroup] 2023-11-30 20:56:04,793 INFO [M:0;jenkins-hbase4:43087] master.MasterMobCompactionThread(168): Waiting for Mob Compaction Thread to finish... 2023-11-30 20:56:04,793 INFO [M:0;jenkins-hbase4:43087] master.MasterMobCompactionThread(168): Waiting for Region Server Mob Compaction Thread to finish... 2023-11-30 20:56:04,793 INFO [M:0;jenkins-hbase4:43087] hbase.ChoreService(369): Chore service for: master/jenkins-hbase4:0 had [] on shutdown 2023-11-30 20:56:04,793 DEBUG [M:0;jenkins-hbase4:43087] master.HMaster(1512): Stopping service threads 2023-11-30 20:56:04,793 INFO [M:0;jenkins-hbase4:43087] procedure2.RemoteProcedureDispatcher(119): Stopping procedure remote dispatcher 2023-11-30 20:56:04,794 ERROR [M:0;jenkins-hbase4:43087] procedure2.ProcedureExecutor(699): ThreadGroup java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] contains running threads; null: See STDOUT java.lang.ThreadGroup[name=PEWorkerGroup,maxpri=10] Thread[HFileArchiver-20,5,PEWorkerGroup] Thread[HFileArchiver-21,5,PEWorkerGroup] Thread[HFileArchiver-22,5,PEWorkerGroup] 2023-11-30 20:56:04,794 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeDeleted, state=SyncConnected, path=/hbase/master 2023-11-30 20:56:04,794 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=NodeChildrenChanged, state=SyncConnected, path=/hbase 2023-11-30 20:56:04,794 DEBUG [zk-event-processor-pool-0] zookeeper.ZKUtil(165): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Set watcher on znode that does not yet exist, /hbase/master 2023-11-30 20:56:04,794 INFO [M:0;jenkins-hbase4:43087] region.RegionProcedureStore(113): Stopping the Region Procedure Store, isAbort=false 2023-11-30 20:56:04,794 DEBUG [normalizer-worker-0] normalizer.RegionNormalizerWorker(174): interrupt detected. terminating. 2023-11-30 20:56:04,795 DEBUG [M:0;jenkins-hbase4:43087] zookeeper.ZKUtil(399): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Unable to get data of znode /hbase/master because node does not exist (not an error) 2023-11-30 20:56:04,795 WARN [M:0;jenkins-hbase4:43087] master.ActiveMasterManager(326): Failed get of master address: java.io.IOException: Can't get master address from ZooKeeper; znode data == null 2023-11-30 20:56:04,795 INFO [M:0;jenkins-hbase4:43087] assignment.AssignmentManager(315): Stopping assignment manager 2023-11-30 20:56:04,795 INFO [M:0;jenkins-hbase4:43087] region.MasterRegion(167): Closing local region {ENCODED => 1595e783b53d99cd5eef43b6debb2682, NAME => 'master:store,,1.1595e783b53d99cd5eef43b6debb2682.', STARTKEY => '', ENDKEY => ''}, isAbort=false 2023-11-30 20:56:04,795 DEBUG [M:0;jenkins-hbase4:43087] regionserver.HRegion(1604): Closing 1595e783b53d99cd5eef43b6debb2682, disabling compactions & flushes 2023-11-30 20:56:04,795 INFO [M:0;jenkins-hbase4:43087] regionserver.HRegion(1626): Closing region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-30 20:56:04,795 DEBUG [M:0;jenkins-hbase4:43087] regionserver.HRegion(1647): Waiting without time limit for close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-30 20:56:04,795 DEBUG [M:0;jenkins-hbase4:43087] regionserver.HRegion(1714): Acquired close lock on master:store,,1.1595e783b53d99cd5eef43b6debb2682. after waiting 0 ms 2023-11-30 20:56:04,795 DEBUG [M:0;jenkins-hbase4:43087] regionserver.HRegion(1724): Updates disabled for region master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-30 20:56:04,795 INFO [M:0;jenkins-hbase4:43087] regionserver.HRegion(2745): Flushing 1595e783b53d99cd5eef43b6debb2682 1/1 column families, dataSize=515.80 KB heapSize=602.07 KB 2023-11-30 20:56:04,889 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-30 20:56:04,889 INFO [RS:0;jenkins-hbase4:40365] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,40365,1701377600631; zookeeper connection closed. 2023-11-30 20:56:04,889 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): regionserver:40365-0x1004011c8640001, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-30 20:56:04,890 INFO [Shutdown of org.apache.hadoop.hbase.fs.HFileSystem@27d1a297] hbase.MiniHBaseCluster$SingleFileSystemShutdownThread(215): Hook closing fs=org.apache.hadoop.hbase.fs.HFileSystem@27d1a297 2023-11-30 20:56:04,890 INFO [Listener at localhost/34291] util.JVMClusterUtil(335): Shutdown of 1 master(s) and 1 regionserver(s) complete 2023-11-30 20:56:05,202 INFO [M:0;jenkins-hbase4:43087] regionserver.DefaultStoreFlusher(82): Flushed memstore data size=515.80 KB at sequenceid=1011 (bloomFilter=true), to=hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c65948b7b3f41178db1a48b0e5ad6a1 2023-11-30 20:56:05,208 INFO [M:0;jenkins-hbase4:43087] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c65948b7b3f41178db1a48b0e5ad6a1 2023-11-30 20:56:05,209 DEBUG [M:0;jenkins-hbase4:43087] regionserver.HRegionFileSystem(485): Committing hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/.tmp/proc/6c65948b7b3f41178db1a48b0e5ad6a1 as hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c65948b7b3f41178db1a48b0e5ad6a1 2023-11-30 20:56:05,214 INFO [M:0;jenkins-hbase4:43087] regionserver.StoreFileReader(520): Loaded Delete Family Bloom (CompoundBloomFilter) metadata for 6c65948b7b3f41178db1a48b0e5ad6a1 2023-11-30 20:56:05,214 INFO [M:0;jenkins-hbase4:43087] regionserver.HStore(1080): Added hdfs://localhost:33413/user/jenkins/test-data/7ecb23bc-bc00-f3d8-c7f7-9616aeb4cae1/MasterData/data/master/store/1595e783b53d99cd5eef43b6debb2682/proc/6c65948b7b3f41178db1a48b0e5ad6a1, entries=123, sequenceid=1011, filesize=33.4 K 2023-11-30 20:56:05,215 INFO [M:0;jenkins-hbase4:43087] regionserver.HRegion(2948): Finished flush of dataSize ~515.80 KB/528177, heapSize ~602.05 KB/616504, currentSize=0 B/0 for 1595e783b53d99cd5eef43b6debb2682 in 420ms, sequenceid=1011, compaction requested=false 2023-11-30 20:56:05,216 INFO [M:0;jenkins-hbase4:43087] regionserver.HRegion(1838): Closed master:store,,1.1595e783b53d99cd5eef43b6debb2682. 2023-11-30 20:56:05,216 DEBUG [M:0;jenkins-hbase4:43087] regionserver.HRegion(1558): Region close journal for 1595e783b53d99cd5eef43b6debb2682: 2023-11-30 20:56:05,219 INFO [M:0;jenkins-hbase4:43087] flush.MasterFlushTableProcedureManager(83): stop: server shutting down. 2023-11-30 20:56:05,220 INFO [M:0;jenkins-hbase4:43087] ipc.NettyRpcServer(158): Stopping server on /172.31.14.131:43087 2023-11-30 20:56:05,221 INFO [master:store-WAL-Roller] wal.AbstractWALRoller(243): LogRoller exiting. 2023-11-30 20:56:05,227 DEBUG [M:0;jenkins-hbase4:43087] zookeeper.RecoverableZooKeeper(172): Node /hbase/rs/jenkins-hbase4.apache.org,43087,1701377599413 already deleted, retry=false 2023-11-30 20:56:05,330 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-30 20:56:05,330 INFO [M:0;jenkins-hbase4:43087] regionserver.HRegionServer(1230): Exiting; stopping=jenkins-hbase4.apache.org,43087,1701377599413; zookeeper connection closed. 2023-11-30 20:56:05,330 DEBUG [Listener at localhost/34291-EventThread] zookeeper.ZKWatcher(600): master:43087-0x1004011c8640000, quorum=127.0.0.1:58095, baseZNode=/hbase Received ZooKeeper Event, type=None, state=Closed, path=null 2023-11-30 20:56:05,332 WARN [Listener at localhost/34291] datanode.DirectoryScanner(534): DirectoryScanner: shutdown has been called 2023-11-30 20:56:05,335 INFO [Listener at localhost/34291] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-30 20:56:05,345 WARN [BP-1678533640-172.31.14.131-1701377595919 heartbeating to localhost/127.0.0.1:33413] datanode.IncrementalBlockReportManager(160): IncrementalBlockReportManager interrupted 2023-11-30 20:56:05,346 WARN [BP-1678533640-172.31.14.131-1701377595919 heartbeating to localhost/127.0.0.1:33413] datanode.BPServiceActor(857): Ending block pool service for: Block pool BP-1678533640-172.31.14.131-1701377595919 (Datanode Uuid 1cd6f58d-a09b-45ae-95f6-a9f17ea7456d) service to localhost/127.0.0.1:33413 2023-11-30 20:56:05,348 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/cluster_1a0b3a74-9b82-6bde-be73-7dfdec67973f/dfs/data/data1/current/BP-1678533640-172.31.14.131-1701377595919] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-30 20:56:05,349 WARN [refreshUsed-/home/jenkins/jenkins-home/workspace/HBase-Flaky-Tests_branch-2.4/hbase-server/target/test-data/07206b85-14d1-5f4c-6936-77bd09a2440a/cluster_1a0b3a74-9b82-6bde-be73-7dfdec67973f/dfs/data/data2/current/BP-1678533640-172.31.14.131-1701377595919] fs.CachingGetSpaceUsed$RefreshThread(183): Thread Interrupted waiting to refresh disk information: sleep interrupted 2023-11-30 20:56:05,396 INFO [Listener at localhost/34291] log.Slf4jLog(67): Stopped HttpServer2$SelectChannelConnectorWithSafeStartup@localhost:0 2023-11-30 20:56:05,536 INFO [Listener at localhost/34291] zookeeper.MiniZooKeeperCluster(344): Shutdown MiniZK cluster with all ZK servers 2023-11-30 20:56:05,631 INFO [Listener at localhost/34291] hbase.HBaseTestingUtility(1293): Minicluster is down